Jul 06 20:23:57.437710 ip-10-0-138-229 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.865949    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873793    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873816    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873822    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873826    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873829    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873832    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873836    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873839    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:57.930194 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873842    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873845    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873848    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873851    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873854    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873857    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873860    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873863    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873865    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873868    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873872    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873875    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873878    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873881    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873884    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873887    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873890    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873892    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873896    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:57.931152 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873899    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873902    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873905    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873908    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873910    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873913    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873916    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873919    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873921    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873924    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873927    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873930    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873933    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873936    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873938    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873941    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873944    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873947    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873949    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873952    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:57.931761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873956    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873958    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873961    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873964    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873969    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873973    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873976    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873979    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873982    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873986    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873989    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873993    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873996    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.873999    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874002    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874005    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874008    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874011    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874015    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:57.932355 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874018    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874021    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874024    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874026    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874029    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874032    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874034    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874037    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874040    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874042    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874045    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874048    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874050    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874053    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874056    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874059    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874063    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874072    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874075    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874078    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:57.933082 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874080    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874083    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874086    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874088    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874093    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874096    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874099    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874101    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874105    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874108    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874110    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874113    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.874116    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875842    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875852    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875856    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875859    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875862    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875866    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:57.933761 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875869    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875871    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875876    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875880    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875884    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875888    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875891    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875893    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875896    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875898    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875901    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875911    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875914    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875917    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875920    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875923    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875926    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875929    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875932    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:57.934298 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875934    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875937    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875940    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875943    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875946    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875949    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875952    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875954    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875957    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875960    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875963    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875966    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875969    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875972    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875975    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875977    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875980    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875984    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875987    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875990    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:57.935103 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875993    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875995    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.875998    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876001    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876005    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876014    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876017    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876020    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876023    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876025    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876028    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876032    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876035    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876038    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876043    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876046    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876050    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876053    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876056    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:57.936143 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876059    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876063    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876067    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876070    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876074    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876077    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876081    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876084    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876087    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876090    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876093    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876096    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876099    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876102    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876105    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876108    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876110    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876113    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876116    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:57.937007 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876125    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876128    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876130    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876133    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876136    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876139    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876142    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876144    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876147    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876149    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876152    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876155    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876157    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876160    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876162    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876166    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876675    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876681    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876684    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876687    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:57.937766 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876690    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876694    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876698    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876701    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876703    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876706    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876709    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876712    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876717    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876720    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876722    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876725    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876734    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876737    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876740    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876743    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876745    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876748    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876751    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:57.938579 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876754    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876757    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876759    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876762    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876765    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876767    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876770    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876773    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876776    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876779    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876782    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876784    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876787    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876790    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876792    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876795    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876799    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876801    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876804    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876806    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:57.939342 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876809    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876814    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876816    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876819    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876822    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876825    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876834    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876837    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876839    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876842    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876845    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876849    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876852    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876854    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876859    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876862    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876865    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876867    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876870    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876873    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:57.940037 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876875    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876878    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876880    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876883    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876886    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876889    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876892    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876894    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876899    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876902    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876905    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876909    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876912    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876916    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876919    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876922    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876924    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876927    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876930    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:57.941266 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876933    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876936    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876938    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876941    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876945    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876948    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876950    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876953    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876956    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876959    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876961    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876964    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876967    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876971    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876974    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876977    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.876980    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877057    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877067    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877080    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 20:23:57.942362 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877085    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877089    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877093    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877097    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877102    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877105    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877112    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877115    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877119    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877122    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877126    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877129    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877132    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877142    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877146    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877151    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877167    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877171    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877175    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877179    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877189    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877192    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877195    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 20:23:57.943706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877199    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877203    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877206    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877209    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877212    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877216    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877220    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877223    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877226    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877229    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877233    2571 flags.go:64] FLAG: --enable-server="true"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877236    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877241    2571 flags.go:64] FLAG: --event-burst="100"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877244    2571 flags.go:64] FLAG: --event-qps="50"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877247    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877253    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877256    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877260    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877263    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877266    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877269    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877273    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877276    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877280    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877283    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 20:23:57.945018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877287    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877290    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877294    2571 flags.go:64] FLAG: --feature-gates=""
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877297    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877301    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877304    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877307    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877310    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877313    2571 flags.go:64] FLAG: --help="false"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877316    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-138-229.ec2.internal"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877320    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877323    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877326    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877329    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877333    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877336    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877339    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877342    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877345    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877348    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877351    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877354    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877359    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877362    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 20:23:57.946543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877365    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877368    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877371    2571 flags.go:64] FLAG: --lock-file=""
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877374    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877377    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877380    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877386    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877390    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877395    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877398    2571 flags.go:64] FLAG: --logging-format="text"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877401    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877404    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877407    2571 flags.go:64] FLAG: --manifest-url=""
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877426    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877432    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877435    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877439    2571 flags.go:64] FLAG: --max-pods="110"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877442    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877445    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877448    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877452    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877455    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877458    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877461    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877469    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 20:23:57.947568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877473    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877476    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877479    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877482    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877488    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877491    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877496    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877499    2571 flags.go:64] FLAG: --port="10250"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877502    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877505    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-059c2a61d0bebd804"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877509    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877512    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877515    2571 flags.go:64] FLAG: --register-node="true"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877518    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877522    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877527    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877530    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877534    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877538    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877541    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877544    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877547    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877551    2571 flags.go:64] FLAG: --runonce="false"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877554    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877557    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 20:23:57.948356 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877560    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 20:23:57.949104 ip-10-0-138-229 systemd[1]: Started Kubernetes Kubelet.
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877563    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877566    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877569    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877573    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877576    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877579    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877582    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877585    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877588    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877591    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877595    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877598    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877606    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877609    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877612    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877617    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877620    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877623    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877626    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877629    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877633    2571 flags.go:64] FLAG: --v="2"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877639    2571 flags.go:64] FLAG: --version="false"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877644    2571 flags.go:64] FLAG: --vmodule=""
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877648    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 20:23:57.949694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.877652    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877788    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877792    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877795    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877798    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877801    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877804    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877807    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877810    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877813    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877818    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877821    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877824    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877827    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877830    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877834    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877838    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877841    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877845    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:57.951368 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877848    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877853    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877856    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877859    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877862    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877865    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877868    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877871    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877874    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877876    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877880    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877883    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877887    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877889    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877892    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877895    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877898    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877902    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877906    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877909    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:57.952575 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877912    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877915    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877917    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877920    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877923    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877926    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877929    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877931    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877934    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877937    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877940    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877942    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877945    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877949    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877953    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877956    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877959    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877961    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877964    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877967    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:57.953248 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877970    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877972    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877976    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877979    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877981    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877985    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877987    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877990    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877993    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877996    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.877998    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878001    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878004    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878007    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878009    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878012    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878015    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878017    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878020    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878023    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:57.954059 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878025    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878028    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878031    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878033    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878036    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878040    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878043    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878046    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878049    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878051    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878054    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878057    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878060    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878062    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878067    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878069    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878072    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878075    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878078    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:57.954784 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878081    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.878084    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.878090    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.885850    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.885873    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.885895    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.885902    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885972    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885979    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885983    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885986    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885989    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885993    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885995    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.885998    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:57.955469 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886001    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886004    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886007    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886010    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886013    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886016    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886020    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886023    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886026    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886029    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886032    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886035    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886037    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886040    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886043    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886046    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886049    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886052    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886055    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886058    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:58.049293 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886061    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886065    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886067    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886070    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886073    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886076    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886080    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886083    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886086    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886089    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886092    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886095    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886099    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886103    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886106    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886109    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886112    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886115    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886118    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:58.050213 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886120    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886123    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886126    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886128    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886131    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886134    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886136    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886139    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886143    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886147    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886151    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886155    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886158    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886161    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886165    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886169    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886172    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886175    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886177    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886180    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:58.051062 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886183    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886186    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886188    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886191    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886194    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886196    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886199    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886201    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886204    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886207    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886209    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886212    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886215    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886218    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886220    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886223    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886226    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886229    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886232    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886234    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:58.052024 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886237    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886240    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886243    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886246    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886248    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886251    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886254    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886259    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886263    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886266    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886269    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886272    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.886277    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886430    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:23:58.052751 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886435    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886438    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886441    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886444    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886447    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886450    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886453    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886456    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886459    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886462    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886464    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886467    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886470    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886476    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886479    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886482    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886484    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886487    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886490    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886493    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:23:58.053259 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886496    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886499    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886501    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886504    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886507    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886510    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886513    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886516    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886519    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886522    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886525    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886527    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886530    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886533    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886535    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886538    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886541    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886543    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886546    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886549    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:23:58.054070 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886552    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886554    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886557    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886560    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886562    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886567    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886569    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886572    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886575    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886577    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886580    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886582    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886585    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886588    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886590    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886593    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886596    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886600    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886603    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886606    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:23:58.054831 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886609    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886612    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886615    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886617    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886620    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886623    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886625    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886629    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886633    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886636    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886639    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886642    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886645    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886648    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886651    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886654    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886657    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886661    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886663    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886666    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:23:58.055506 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886669    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886672    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886676    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886679    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886683    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886686    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886690    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886693    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886696    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886700    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886703    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886706    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886709    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886712    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886714    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886717    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886720    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:23:58.056138 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:57.886722    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.886728    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.886880    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.889380    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.891001    2571 server.go:1019] "Starting client certificate rotation"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.891122    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.891163    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.894036    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.901635    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.913444    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.915765    2571 log.go:25] "Validated CRI v1 image API"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.916650    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 20:23:58.057658 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.919111    2571 fs.go:135] Filesystem UUIDs: map[67513dcf-c1c1-4d97-a686-005dfd2b77de:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 96d9ab7c-6040-4766-bd49-4dc90af2dd04:/dev/nvme0n1p3]
Jul 06 20:23:58.173252 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.919127    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.924531    2571 manager.go:216] Machine: {Timestamp:2026-07-06 20:23:57.923188539 +0000 UTC m=+0.358841711 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106845 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9493d96efc784941ed38f7a6ff22 SystemUUID:ec2a9493-d96e-fc78-4941-ed38f7a6ff22 BootID:0af9a6cd-dd87-46e1-8b68-b7af190f231d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:10:df:41:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:10:df:41:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:70:71:e1:dc:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.924656    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.924820    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.925940    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.925974    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.926691    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.926704    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 20:23:58.199995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.926713    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.927522    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.929275    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.930973    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932502    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932651    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932688    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932702    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932729    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932743    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.932753    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.933187    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.933211    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.935448    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.937633    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.937680    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938878    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938900    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938910    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938919    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938935    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938945    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938958    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938967    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938981    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.938990    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.939003    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.939012    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.939993    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.940013    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.945956    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.946096    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.946299    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.946653    2571 server.go:1268] "Started kubelet"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.947028    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.947008    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.948862    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.950835    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.951600    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 20:23:58.200887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.956025    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.956739    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-229.ec2.internal.18bfcd0e1c1438db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-229.ec2.internal,UID:ip-10-0-138-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-229.ec2.internal,},FirstTimestamp:2026-07-06 20:23:57.946329307 +0000 UTC m=+0.381982480,LastTimestamp:2026-07-06 20:23:57.946329307 +0000 UTC m=+0.381982480,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-229.ec2.internal,}"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.959585    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.959698    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.959736    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.960369    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.960386    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.960489    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.960606    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.960614    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961218    2571 factory.go:55] Registering systemd factory
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961234    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961508    2571 factory.go:153] Registering CRI-O factory
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961526    2571 factory.go:223] Registration of the crio container factory successfully
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961592    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961618    2571 factory.go:103] Registering Raw factory
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.961635    2571 manager.go:1196] Started watching for new ooms in manager
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.962209    2571 manager.go:349] Starting recovery of all containers
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.962575    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd2nc"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.971772    2571 manager.go:354] Recovery completed
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.974489    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:57.974574    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.975258    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wd2nc"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.979066    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.981119    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.981146    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.981158    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.982031    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.982042    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.982063    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.983303    2571 policy_none.go:49] "None policy: Start"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.983321    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.983334    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.984519    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.203274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.984533    2571 policy_none.go:47] "Start"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.985410    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.985436    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:57.985448    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.038270    2571 manager.go:337] "Starting Device Plugin manager"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.038539    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.038555    2571 server.go:87] "Starting device plugin registration server"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.038885    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.038898    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.039006    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.039106    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.039117    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.039726    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.039774    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.139730    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.140922    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.140957    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.140969    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.140999    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.152709    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.152741    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-229.ec2.internal\": node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.167283    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.168582    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.168625    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.168653    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.168698    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.170120    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.204821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.171036    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.268860    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"]
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.268949    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.271026    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.271504    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.271540    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.271553    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.273233    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.273351    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.273395    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274300    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274331    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274300    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274346    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274398    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.274418    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.275812    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.275837    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.276725    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.276757    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:23:58.298870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.276772    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.310644    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-229.ec2.internal\" not found" node="ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.315770    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-229.ec2.internal\" not found" node="ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.363173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.363212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.363239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/439c997d82aa77501d70907300d26dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-229.ec2.internal\" (UID: \"439c997d82aa77501d70907300d26dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.431472 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.371608    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464390    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/439c997d82aa77501d70907300d26dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-229.ec2.internal\" (UID: \"439c997d82aa77501d70907300d26dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464457    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1cfd8ab27d70968a348dabb4ec7378d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal\" (UID: \"c1cfd8ab27d70968a348dabb4ec7378d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.464491    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/439c997d82aa77501d70907300d26dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-229.ec2.internal\" (UID: \"439c997d82aa77501d70907300d26dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.568891 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.471740    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.656530 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.572328    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.656530 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.616777    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.656530 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.619140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.673011 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.672983    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.773487 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.773440    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.874039 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:58.873992    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-229.ec2.internal\" not found"
Jul 06 20:23:58.890185 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.890156    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 20:23:58.890395 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.890376    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 20:23:58.943535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.943504    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:23:58.949835 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.949810    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:23:58.961751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.961729    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 20:23:58.961751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.961741    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.973630 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.973609    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 20:23:58.976498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.976475    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal"
Jul 06 20:23:58.976610 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.976474    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 20:23:58.977439 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.977399    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:18:58 +0000 UTC" deadline="2027-12-10 18:44:45.845987797 +0000 UTC"
Jul 06 20:23:58.977439 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.977440    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12526h20m46.868550643s"
Jul 06 20:23:58.985865 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.985846    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 20:23:58.996352 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:58.996318    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9fm4q"
Jul 06 20:23:59.007677 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.007645    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9fm4q"
Jul 06 20:23:59.205688 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:59.205648    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439c997d82aa77501d70907300d26dc7.slice/crio-68c2c933b4e9f831b478c327d7ada0e6e458d17b400082015662e580ee4a403b WatchSource:0}: Error finding container 68c2c933b4e9f831b478c327d7ada0e6e458d17b400082015662e580ee4a403b: Status 404 returned error can't find the container with id 68c2c933b4e9f831b478c327d7ada0e6e458d17b400082015662e580ee4a403b
Jul 06 20:23:59.206054 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:23:59.206024    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cfd8ab27d70968a348dabb4ec7378d.slice/crio-ad850bc5fbd81ab9dad8f416d730d7ecc58cfe72a825bd0e777c68e92edae197 WatchSource:0}: Error finding container ad850bc5fbd81ab9dad8f416d730d7ecc58cfe72a825bd0e777c68e92edae197: Status 404 returned error can't find the container with id ad850bc5fbd81ab9dad8f416d730d7ecc58cfe72a825bd0e777c68e92edae197
Jul 06 20:23:59.210813 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.210796    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:23:59.267793 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.267753    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:23:59.721423 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.721388    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:23:59.933308 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.933266    2571 apiserver.go:52] "Watching apiserver"
Jul 06 20:23:59.940086 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.940055    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 20:23:59.940905 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.940533    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4cw7x","openshift-multus/multus-additional-cni-plugins-9vg6w","kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal","openshift-image-registry/node-ca-sx97n","openshift-multus/network-metrics-daemon-bd72t","openshift-network-diagnostics/network-check-target-4vxb4","openshift-network-operator/iptables-alerter-z9rlj","openshift-ovn-kubernetes/ovnkube-node-jtcx4","kube-system/global-pull-secret-syncer-zjskn","kube-system/konnectivity-agent-rnj5t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r","openshift-cluster-node-tuning-operator/tuned-smmm9","openshift-dns/node-resolver-lzr7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal"]
Jul 06 20:23:59.942639 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.942617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.944387 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.944346    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.945498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.945477    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 20:23:59.945901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.945879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnw8b\""
Jul 06 20:23:59.947207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.946144    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.947207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.946403    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.947207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.947050    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 20:23:59.947207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.947070    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gfv9b\""
Jul 06 20:23:59.947207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.947094    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 20:23:59.947559 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.947260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:23:59.947559 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.946845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:23:59.947559 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:59.947336    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:23:59.948238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.947958    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 20:23:59.949533 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.948576    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:23:59.949533 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:59.948651    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:23:59.950187 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.949986    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.950187 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.950077    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.950187 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.950082    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 20:23:59.950396 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.950207    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:23:59.950645 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.950627    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dvklp\""
Jul 06 20:23:59.952757 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.952734    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 20:23:59.952910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.952894    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.953022 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.952992    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.953022 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.953005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.953022 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.953015    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbdcq\""
Jul 06 20:23:59.955704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.955684    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:23:59.955813 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:23:59.955764    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:23:59.956517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.956488    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 20:23:59.956766 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.956748    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 20:23:59.956843 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.956766    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 20:23:59.956975 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.956957    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 20:23:59.957062 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.956980    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l88j2\""
Jul 06 20:23:59.957169 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.957156    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.957350 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.957334    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.957645 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.957630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:23:59.967719 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.967493    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.968135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.968108    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 20:23:59.969057 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.969034    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 20:23:59.969720 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.969482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r85lv\""
Jul 06 20:23:59.969824 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.969776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:23:59.970302 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.970012    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.971620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.971235    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hhwzt\""
Jul 06 20:23:59.971620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.971245    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.971620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.971451    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 20:23:59.972632 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.972009    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.972632 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.972102    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zwd7n\""
Jul 06 20:23:59.972632 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.972328    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.972820 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.972750    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.974815    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.974834    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5cjxm\""
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975027    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-multus-certs\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxwz8\" (UniqueName: \"kubernetes.io/projected/49e6b067-73be-4ff3-8d9f-b3420fdc0189-kube-api-access-vxwz8\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975092    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-bin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-multus\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cf26b5d-764d-43a8-941b-eab56add0bc1-host\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32bb181f-c8d7-466b-89ab-810903b46c16-iptables-alerter-script\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-socket-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975170    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-device-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-socket-dir-parent\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-kubelet\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-env-overrides\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-script-lib\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-sys-fs\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfmn\" (UniqueName: \"kubernetes.io/projected/6cf26b5d-764d-43a8-941b-eab56add0bc1-kube-api-access-kdfmn\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-systemd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975374    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-system-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-kubelet-config\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cnibin\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975509    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-kubelet\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975548    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-systemd-units\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-bin\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.977831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975632    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-conf-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975704    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cf26b5d-764d-43a8-941b-eab56add0bc1-serviceca\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mprsw\" (UniqueName: \"kubernetes.io/projected/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-kube-api-access-mprsw\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-etc-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-log-socket\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-config\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.975912    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovn-node-metrics-cert\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-registration-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-os-release\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.978488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-os-release\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-slash\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-etc-selinux\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-hostroot\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-system-cni-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698c21fe-d480-4a3d-b295-026556aca1f0-agent-certs\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-netns\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-ovn\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25rfn\" (UniqueName: \"kubernetes.io/projected/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kube-api-access-25rfn\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-etc-kubernetes\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-netns\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzclg\" (UniqueName: \"kubernetes.io/projected/d2f688e8-2ce8-414a-a25a-3072bd702ed3-kube-api-access-kzclg\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976549    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cni-binary-copy\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976567    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cnibin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-k8s-cni-cncf-io\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-dbus\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32bb181f-c8d7-466b-89ab-810903b46c16-host-slash\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wqqz\" (UniqueName: \"kubernetes.io/projected/32bb181f-c8d7-466b-89ab-810903b46c16-kube-api-access-5wqqz\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976716    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-var-lib-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-netd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698c21fe-d480-4a3d-b295-026556aca1f0-konnectivity-ca\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-daemon-config\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx8x4\" (UniqueName: \"kubernetes.io/projected/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-kube-api-access-mx8x4\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:23:59.979869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:23:59.976938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-node-log\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.009336 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.009290    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:18:58 +0000 UTC" deadline="2028-03-06 10:29:03.637596662 +0000 UTC"
Jul 06 20:24:00.009336 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.009333    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14606h5m3.628266555s"
Jul 06 20:24:00.062165 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.062133    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 20:24:00.077323 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cnibin\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-kubelet\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-systemd-units\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-bin\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-sys\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.077506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-conf-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077545    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-kubelet\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077566    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-bin\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-var-lib-kubelet\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077579    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-systemd-units\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077621    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-conf-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077639    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077683    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cf26b5d-764d-43a8-941b-eab56add0bc1-serviceca\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077583    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cnibin\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mprsw\" (UniqueName: \"kubernetes.io/projected/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-kube-api-access-mprsw\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:00.077829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-kubernetes\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-run\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-etc-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-log-socket\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-config\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovn-node-metrics-cert\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.077965    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-registration-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078033    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-log-socket\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-os-release\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078076    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-etc-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078072    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-os-release\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078115    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.078513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-slash\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-etc-selinux\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-hostroot\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-systemd\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-system-cni-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078266    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078311    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6cf26b5d-764d-43a8-941b-eab56add0bc1-serviceca\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698c21fe-d480-4a3d-b295-026556aca1f0-agent-certs\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078342    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-registration-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-netns\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-ovn\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25rfn\" (UniqueName: \"kubernetes.io/projected/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kube-api-access-25rfn\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078434    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-os-release\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-etc-kubernetes\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078510    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-netns\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078538    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-ovn\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078662    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078676    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078749    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-etc-kubernetes\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078784    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-config\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078793    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-os-release\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078836    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-etc-selinux\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078852    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-system-cni-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078864    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-hostroot\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-conf\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078919    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-slash\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078932    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-host\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078948    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49e6b067-73be-4ff3-8d9f-b3420fdc0189-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-netns\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.078997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzclg\" (UniqueName: \"kubernetes.io/projected/d2f688e8-2ce8-414a-a25a-3072bd702ed3-kube-api-access-kzclg\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cni-binary-copy\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079041    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-netns\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-etc-tuned\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cnibin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-k8s-cni-cncf-io\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079205    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cnibin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079232    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-k8s-cni-cncf-io\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-dbus\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32bb181f-c8d7-466b-89ab-810903b46c16-host-slash\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079291    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wqqz\" (UniqueName: \"kubernetes.io/projected/32bb181f-c8d7-466b-89ab-810903b46c16-kube-api-access-5wqqz\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-var-lib-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-netd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.080686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698c21fe-d480-4a3d-b295-026556aca1f0-konnectivity-ca\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.079396    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-dbus\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-daemon-config\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx8x4\" (UniqueName: \"kubernetes.io/projected/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-kube-api-access-mx8x4\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.079466    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:00.5794436 +0000 UTC m=+3.015096775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079465    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-var-lib-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079532    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32bb181f-c8d7-466b-89ab-810903b46c16-host-slash\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-node-log\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-multus-certs\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8wr\" (UniqueName: \"kubernetes.io/projected/0f76941f-afdf-4b2d-9763-060518a2aede-kube-api-access-wc8wr\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0062ec7-3059-4fbf-81d7-446b387d34e3-tmp-dir\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.081311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxwz8\" (UniqueName: \"kubernetes.io/projected/49e6b067-73be-4ff3-8d9f-b3420fdc0189-kube-api-access-vxwz8\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079693    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-bin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-multus\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cf26b5d-764d-43a8-941b-eab56add0bc1-host\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079758    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-cni-binary-copy\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32bb181f-c8d7-466b-89ab-810903b46c16-iptables-alerter-script\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079863    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-socket-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-device-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-socket-dir-parent\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-kubelet\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.079973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-tmp\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-env-overrides\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080028    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-script-lib\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.081995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080001    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-node-log\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080116    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-run-multus-certs\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.080209    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.080260    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:00.580241918 +0000 UTC m=+3.015895088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-sys-fs\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-daemon-config\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080329    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/698c21fe-d480-4a3d-b295-026556aca1f0-konnectivity-ca\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfmn\" (UniqueName: \"kubernetes.io/projected/6cf26b5d-764d-43a8-941b-eab56add0bc1-kube-api-access-kdfmn\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080410    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-cni-netd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-systemd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080471    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-sys-fs\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-system-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080493    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-env-overrides\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.082663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysconfig\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0062ec7-3059-4fbf-81d7-446b387d34e3-hosts-file\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-systemd\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-kubelet-config\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080579    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-bin\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-modprobe-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-lib-modules\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080629    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-multus-socket-dir-parent\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080633    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-socket-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080638    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfl4t\" (UniqueName: \"kubernetes.io/projected/e0062ec7-3059-4fbf-81d7-446b387d34e3-kube-api-access-hfl4t\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080676    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cf26b5d-764d-43a8-941b-eab56add0bc1-host\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080773    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88356ccd-ae8a-43d7-b046-5d0612d50d08-kubelet-config\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080787    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-kubelet\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080815    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-host-var-lib-cni-multus\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.083316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080826    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080848    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2f688e8-2ce8-414a-a25a-3072bd702ed3-run-openvswitch\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080857    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-system-cni-dir\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080788    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32bb181f-c8d7-466b-89ab-810903b46c16-iptables-alerter-script\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080914    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-device-dir\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.080978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49e6b067-73be-4ff3-8d9f-b3420fdc0189-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.083960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.081011    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovnkube-script-lib\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.084478 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.084423    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/698c21fe-d480-4a3d-b295-026556aca1f0-agent-certs\") pod \"konnectivity-agent-rnj5t\" (UID: \"698c21fe-d480-4a3d-b295-026556aca1f0\") " pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:00.087722 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.087598    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2f688e8-2ce8-414a-a25a-3072bd702ed3-ovn-node-metrics-cert\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.088907 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.088707    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:00.088907 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.088742    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:00.088907 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.088767    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:00.088907 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.088854    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:00.588825796 +0000 UTC m=+3.024478955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:00.092952 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.092833    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mprsw\" (UniqueName: \"kubernetes.io/projected/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-kube-api-access-mprsw\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:00.092952 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.092855    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfmn\" (UniqueName: \"kubernetes.io/projected/6cf26b5d-764d-43a8-941b-eab56add0bc1-kube-api-access-kdfmn\") pod \"node-ca-sx97n\" (UID: \"6cf26b5d-764d-43a8-941b-eab56add0bc1\") " pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.093877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.093576    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wqqz\" (UniqueName: \"kubernetes.io/projected/32bb181f-c8d7-466b-89ab-810903b46c16-kube-api-access-5wqqz\") pod \"iptables-alerter-z9rlj\" (UID: \"32bb181f-c8d7-466b-89ab-810903b46c16\") " pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.093877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.093670    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25rfn\" (UniqueName: \"kubernetes.io/projected/a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02-kube-api-access-25rfn\") pod \"aws-ebs-csi-driver-node-fww8r\" (UID: \"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.094092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.094069    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx8x4\" (UniqueName: \"kubernetes.io/projected/7a7d8d4f-f8e3-447b-9fe2-77cc1242f237-kube-api-access-mx8x4\") pod \"multus-4cw7x\" (UID: \"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237\") " pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.094293 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.094270    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxwz8\" (UniqueName: \"kubernetes.io/projected/49e6b067-73be-4ff3-8d9f-b3420fdc0189-kube-api-access-vxwz8\") pod \"multus-additional-cni-plugins-9vg6w\" (UID: \"49e6b067-73be-4ff3-8d9f-b3420fdc0189\") " pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.095526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.095506    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzclg\" (UniqueName: \"kubernetes.io/projected/d2f688e8-2ce8-414a-a25a-3072bd702ed3-kube-api-access-kzclg\") pod \"ovnkube-node-jtcx4\" (UID: \"d2f688e8-2ce8-414a-a25a-3072bd702ed3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.173283 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.173214    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal" event={"ID":"439c997d82aa77501d70907300d26dc7","Type":"ContainerStarted","Data":"68c2c933b4e9f831b478c327d7ada0e6e458d17b400082015662e580ee4a403b"}
Jul 06 20:24:00.174420 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.174389    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal" event={"ID":"c1cfd8ab27d70968a348dabb4ec7378d","Type":"ContainerStarted","Data":"ad850bc5fbd81ab9dad8f416d730d7ecc58cfe72a825bd0e777c68e92edae197"}
Jul 06 20:24:00.181842 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.181804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8wr\" (UniqueName: \"kubernetes.io/projected/0f76941f-afdf-4b2d-9763-060518a2aede-kube-api-access-wc8wr\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.181842 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.181842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0062ec7-3059-4fbf-81d7-446b387d34e3-tmp-dir\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.182076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.181865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-tmp\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysconfig\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0062ec7-3059-4fbf-81d7-446b387d34e3-hosts-file\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.182076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-modprobe-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182068    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysconfig\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182093    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-lib-modules\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182139    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e0062ec7-3059-4fbf-81d7-446b387d34e3-hosts-file\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfl4t\" (UniqueName: \"kubernetes.io/projected/e0062ec7-3059-4fbf-81d7-446b387d34e3-kube-api-access-hfl4t\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-sys\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182206    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0062ec7-3059-4fbf-81d7-446b387d34e3-tmp-dir\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182245    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-lib-modules\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-var-lib-kubelet\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182264    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-modprobe-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182293    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-sys\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182336    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-var-lib-kubelet\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-kubernetes\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182422    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-kubernetes\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-run\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-systemd\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182469    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-run\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182520    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-systemd\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-conf\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-host\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-etc-tuned\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182621    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-d\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182664    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-host\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.182864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.182735    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f76941f-afdf-4b2d-9763-060518a2aede-etc-sysctl-conf\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.184481 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.184456    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-tmp\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.185389 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.185367    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f76941f-afdf-4b2d-9763-060518a2aede-etc-tuned\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.193550 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.193509    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8wr\" (UniqueName: \"kubernetes.io/projected/0f76941f-afdf-4b2d-9763-060518a2aede-kube-api-access-wc8wr\") pod \"tuned-smmm9\" (UID: \"0f76941f-afdf-4b2d-9763-060518a2aede\") " pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.193820 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.193789    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfl4t\" (UniqueName: \"kubernetes.io/projected/e0062ec7-3059-4fbf-81d7-446b387d34e3-kube-api-access-hfl4t\") pod \"node-resolver-lzr7s\" (UID: \"e0062ec7-3059-4fbf-81d7-446b387d34e3\") " pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.268267 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.268183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cw7x"
Jul 06 20:24:00.277686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.277647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vg6w"
Jul 06 20:24:00.286674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.286647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sx97n"
Jul 06 20:24:00.295628 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.295592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9rlj"
Jul 06 20:24:00.303534 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.303502    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:00.309603 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.309576    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:00.319523 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.319488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r"
Jul 06 20:24:00.328405 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.328374    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smmm9"
Jul 06 20:24:00.334068 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.334043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzr7s"
Jul 06 20:24:00.585607 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.585517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:00.585607 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.585574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:00.585796 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.585696    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:00.585796 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.585727    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:00.585796 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.585768    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:01.585747015 +0000 UTC m=+4.021400181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:00.585796 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.585790    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:01.585778577 +0000 UTC m=+4.021431738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:00.686530 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:00.686495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:00.686715 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.686649    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:00.686715 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.686666    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:00.686715 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.686675    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:00.686861 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:00.686735    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:01.686716254 +0000 UTC m=+4.122369422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:01.010479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.010419    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:18:58 +0000 UTC" deadline="2028-02-23 23:39:30.971795972 +0000 UTC"
Jul 06 20:24:01.010479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.010472    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14331h15m29.961329095s"
Jul 06 20:24:01.169434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.169293    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:01.169434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.169330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:01.169434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.169330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:01.169746 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.169468    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:01.169746 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.169706    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:01.169888 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.169863    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:01.172053 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:01.172022    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f76941f_afdf_4b2d_9763_060518a2aede.slice/crio-87985789f0e80828816942a4a946d5eea53b83c10596b96356c5afbdc0694482 WatchSource:0}: Error finding container 87985789f0e80828816942a4a946d5eea53b83c10596b96356c5afbdc0694482: Status 404 returned error can't find the container with id 87985789f0e80828816942a4a946d5eea53b83c10596b96356c5afbdc0694482
Jul 06 20:24:01.173437 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:01.173413    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bb181f_c8d7_466b_89ab_810903b46c16.slice/crio-03dff2757ba494fd514e7ad489caa0ad3ab99acd22b9f179fa87b5a9220d6118 WatchSource:0}: Error finding container 03dff2757ba494fd514e7ad489caa0ad3ab99acd22b9f179fa87b5a9220d6118: Status 404 returned error can't find the container with id 03dff2757ba494fd514e7ad489caa0ad3ab99acd22b9f179fa87b5a9220d6118
Jul 06 20:24:01.174337 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:01.174316    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0062ec7_3059_4fbf_81d7_446b387d34e3.slice/crio-39055a1f990ea7ef7d787a1b8710f5427d1fcbb79822a185f91049203c79733d WatchSource:0}: Error finding container 39055a1f990ea7ef7d787a1b8710f5427d1fcbb79822a185f91049203c79733d: Status 404 returned error can't find the container with id 39055a1f990ea7ef7d787a1b8710f5427d1fcbb79822a185f91049203c79733d
Jul 06 20:24:01.177649 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.177618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9rlj" event={"ID":"32bb181f-c8d7-466b-89ab-810903b46c16","Type":"ContainerStarted","Data":"03dff2757ba494fd514e7ad489caa0ad3ab99acd22b9f179fa87b5a9220d6118"}
Jul 06 20:24:01.178664 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:01.178593    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e6b067_73be_4ff3_8d9f_b3420fdc0189.slice/crio-f492ae3950d5a3f3671dff656ef96113d05915eb24ff3f0f080d43fb5ce4154d WatchSource:0}: Error finding container f492ae3950d5a3f3671dff656ef96113d05915eb24ff3f0f080d43fb5ce4154d: Status 404 returned error can't find the container with id f492ae3950d5a3f3671dff656ef96113d05915eb24ff3f0f080d43fb5ce4154d
Jul 06 20:24:01.178887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.178863    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smmm9" event={"ID":"0f76941f-afdf-4b2d-9763-060518a2aede","Type":"ContainerStarted","Data":"87985789f0e80828816942a4a946d5eea53b83c10596b96356c5afbdc0694482"}
Jul 06 20:24:01.180089 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:01.180065    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a7d8d4f_f8e3_447b_9fe2_77cc1242f237.slice/crio-fff10cb496ccdc9c99df263313bfdef5083c3426f5d011dd8d3637897f5748ce WatchSource:0}: Error finding container fff10cb496ccdc9c99df263313bfdef5083c3426f5d011dd8d3637897f5748ce: Status 404 returned error can't find the container with id fff10cb496ccdc9c99df263313bfdef5083c3426f5d011dd8d3637897f5748ce
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.594312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.594615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.594499    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.594726    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.594747    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:03.5947236 +0000 UTC m=+6.030376761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:01.594887 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.594781    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:03.594764944 +0000 UTC m=+6.030418117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:01.695512 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:01.695463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:01.695723 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.695704    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:01.695808 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.695734    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:01.695808 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.695749    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:01.695808 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:01.695807    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:03.695789311 +0000 UTC m=+6.131442487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:02.197933 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.197804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"57e67aa200c4f06f265e743e0c5fad7c89976342e55c5f9d65c4b780ba4cfefe"}
Jul 06 20:24:02.209732 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.209692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnj5t" event={"ID":"698c21fe-d480-4a3d-b295-026556aca1f0","Type":"ContainerStarted","Data":"3929eb52ed4f18d0840c6a5c80bd11cc823d63687bf533cbc7e140f14b140769"}
Jul 06 20:24:02.211899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.211857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r" event={"ID":"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02","Type":"ContainerStarted","Data":"3765c72765d3dd21d4f72260fb42a5d113876053f58af97fe9e1fa833abee66d"}
Jul 06 20:24:02.214494 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.214448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cw7x" event={"ID":"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237","Type":"ContainerStarted","Data":"fff10cb496ccdc9c99df263313bfdef5083c3426f5d011dd8d3637897f5748ce"}
Jul 06 20:24:02.216737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.216664    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerStarted","Data":"f492ae3950d5a3f3671dff656ef96113d05915eb24ff3f0f080d43fb5ce4154d"}
Jul 06 20:24:02.227635 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.227592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal" event={"ID":"439c997d82aa77501d70907300d26dc7","Type":"ContainerStarted","Data":"f6a18986c0528d3d6a53106c2d5d47a9ba3c3caf84f62d4eda05ff5e1ad2e4bf"}
Jul 06 20:24:02.241114 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.241048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sx97n" event={"ID":"6cf26b5d-764d-43a8-941b-eab56add0bc1","Type":"ContainerStarted","Data":"1cfd72f176a611ebea4b84bcae50e27068b7a06bfa1924b3fcab6e7fcb17206d"}
Jul 06 20:24:02.247948 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.247860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzr7s" event={"ID":"e0062ec7-3059-4fbf-81d7-446b387d34e3","Type":"ContainerStarted","Data":"39055a1f990ea7ef7d787a1b8710f5427d1fcbb79822a185f91049203c79733d"}
Jul 06 20:24:02.266487 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.266382    2571 generic.go:356] "Generic (PLEG): container finished" podID="c1cfd8ab27d70968a348dabb4ec7378d" containerID="30e2f005bc7242ed4ac3ccb0bf5639a7dba0c8bbb03927f13bfe2abc06486827" exitCode=0
Jul 06 20:24:02.266487 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.266433    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal" event={"ID":"c1cfd8ab27d70968a348dabb4ec7378d","Type":"ContainerDied","Data":"30e2f005bc7242ed4ac3ccb0bf5639a7dba0c8bbb03927f13bfe2abc06486827"}
Jul 06 20:24:02.284715 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:02.284652    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-229.ec2.internal" podStartSLOduration=4.284628835 podStartE2EDuration="4.284628835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:02.241250958 +0000 UTC m=+4.676904128" watchObservedRunningTime="2026-07-06 20:24:02.284628835 +0000 UTC m=+4.720282005"
Jul 06 20:24:03.169587 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.169524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:03.169770 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.169674    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:03.170273 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.170250    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:03.170407 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.170380    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:03.170480 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.170453    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:03.170546 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.170525    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:03.293816 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.293772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal" event={"ID":"c1cfd8ab27d70968a348dabb4ec7378d","Type":"ContainerStarted","Data":"000ddc9ac0b4d0717779a3ac3fa30a176af54d6e36c2666a36c5731c1d47f586"}
Jul 06 20:24:03.309489 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.308636    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-229.ec2.internal" podStartSLOduration=5.308591559 podStartE2EDuration="5.308591559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:03.307846803 +0000 UTC m=+5.743499982" watchObservedRunningTime="2026-07-06 20:24:03.308591559 +0000 UTC m=+5.744244740"
Jul 06 20:24:03.611649 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.611551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:03.611649 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.611612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:03.611882 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.611816    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:03.611942 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.611886    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:07.611868431 +0000 UTC m=+10.047521600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:03.612456 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.612394    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:03.612456 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.612452    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:07.612434921 +0000 UTC m=+10.048088078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:03.713070 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:03.713029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:03.713302 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.713261    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:03.713302 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.713286    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:03.713302 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.713300    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:03.713508 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:03.713377    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:07.713342572 +0000 UTC m=+10.148995733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:05.169305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:05.169269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:05.169763 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:05.169506    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:05.169959 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:05.169938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:05.170090 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:05.170067    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:05.170157 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:05.170140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:05.170236 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:05.170216    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:07.169920 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.169882    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:07.170438 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.170067    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:07.170438 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.170149    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:07.170438 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.170261    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:07.170438 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.170328    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:07.170672 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.170438    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:07.648297 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.648259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:07.648506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.648315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:07.648506 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.648453    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:07.648631 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.648541    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:15.648516536 +0000 UTC m=+18.084169693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:07.648694 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.648457    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:07.648744 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.648700    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:15.648685387 +0000 UTC m=+18.084338560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:07.749742 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:07.749706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:07.749920 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.749894    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:07.749920 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.749918    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:07.750028 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.749931    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:07.750028 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:07.750007    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:15.749987409 +0000 UTC m=+18.185640573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:09.169526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:09.169489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:09.170029 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:09.169608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:09.170029 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:09.169618    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:09.170029 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:09.169651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:09.170029 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:09.169750    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:09.170029 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:09.169839    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:11.169891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:11.169854    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:11.170450 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:11.169859    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:11.170450 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:11.169994    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:11.170450 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:11.170073    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:11.170450 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:11.169861    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:11.170450 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:11.170182    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:13.169134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:13.169097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:13.169659 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:13.169097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:13.169659 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:13.169221    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:13.169659 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:13.169328    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:13.169659 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:13.169106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:13.169659 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:13.169470    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:15.169597 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.169558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:15.170112 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.169558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:15.170112 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.169692    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:15.170112 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.169795    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:15.170112 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.169558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:15.170112 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.169901    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:15.712692 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.712651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:15.712939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.712711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:15.712939 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.712769    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:15.712939 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.712853    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:31.712829136 +0000 UTC m=+34.148482296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:15.712939 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.712858    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:15.712939 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.712923    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:31.712903967 +0000 UTC m=+34.148557142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:15.814024 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:15.813986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:15.814199 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.814128    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:15.814199 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.814150    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:15.814199 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.814163    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:15.814310 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:15.814228    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:31.814208459 +0000 UTC m=+34.249861617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:17.169009 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:17.168966    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:17.169009 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:17.168987    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:17.169478 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:17.169074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:17.169478 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:17.169088    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:17.169478 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:17.169149    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:17.169478 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:17.169276    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:19.169653 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:19.169602    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:19.170183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:19.169663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:19.170183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:19.169609    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:19.170183 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:19.169746    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:19.170183 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:19.169855    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:19.170183 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:19.169948    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:20.333625 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.333089    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r" event={"ID":"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02","Type":"ContainerStarted","Data":"6ad1ca2cadb6526c8f4253e5d71c35bf24cae7ed0e59433e8ba7e4b6140f8077"}
Jul 06 20:24:20.335080 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.335018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cw7x" event={"ID":"7a7d8d4f-f8e3-447b-9fe2-77cc1242f237","Type":"ContainerStarted","Data":"1053c757d0ce02b3d8464e5ab594f758032dafdf22bfb2ed6c985159f33b6a8d"}
Jul 06 20:24:20.337180 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.337142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerStarted","Data":"acf1c371c94a8d07f2747e94ad8c831807f236f6c40cd503a587a881a345f7bf"}
Jul 06 20:24:20.338904 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.338562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sx97n" event={"ID":"6cf26b5d-764d-43a8-941b-eab56add0bc1","Type":"ContainerStarted","Data":"0c168b860f4130390d16a535818b6b38934daf0054f4fbed5acffb5bdf52716d"}
Jul 06 20:24:20.340724 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.340696    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzr7s" event={"ID":"e0062ec7-3059-4fbf-81d7-446b387d34e3","Type":"ContainerStarted","Data":"d3e69cf7bffd9efe9c37974323f6aeb04fd98f465d4a0d0652541c7e28b8c890"}
Jul 06 20:24:20.342441 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.342213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smmm9" event={"ID":"0f76941f-afdf-4b2d-9763-060518a2aede","Type":"ContainerStarted","Data":"d5c4f6848f9db1968d5a21db4be8c39701363aa86a72aec43a6377e5d87cb9f5"}
Jul 06 20:24:20.343878 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.343814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"dd064207ae59c0dfd3594f74f259e5952e528e9b321c6834d240000a2fc410c4"}
Jul 06 20:24:20.345062 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.345016    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnj5t" event={"ID":"698c21fe-d480-4a3d-b295-026556aca1f0","Type":"ContainerStarted","Data":"bbf8b7176801853ac3805b7ef4cc7bce213da3420679439eb36ac82915322c7d"}
Jul 06 20:24:20.368404 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.368336    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4cw7x" podStartSLOduration=3.5029373379999997 podStartE2EDuration="22.368321682s" totalImagesPullingTime="18.865384344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:20.368082233 +0000 UTC m=+22.803735410" watchObservedRunningTime="2026-07-06 20:24:20.368321682 +0000 UTC m=+22.803974860"
Jul 06 20:24:20.466055 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.466004    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rnj5t" podStartSLOduration=8.264822364 podStartE2EDuration="22.465985962s" totalImagesPullingTime="14.201163598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:20.441508007 +0000 UTC m=+22.877161189" watchObservedRunningTime="2026-07-06 20:24:20.465985962 +0000 UTC m=+22.901639117"
Jul 06 20:24:20.466206 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.466169    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smmm9" podStartSLOduration=3.591669724 podStartE2EDuration="22.466164664s" totalImagesPullingTime="18.87449494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:20.465573529 +0000 UTC m=+22.901226708" watchObservedRunningTime="2026-07-06 20:24:20.466164664 +0000 UTC m=+22.901817842"
Jul 06 20:24:20.484520 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.484472    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sx97n" podStartSLOduration=3.628587594 podStartE2EDuration="22.484453414s" totalImagesPullingTime="18.85586582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:20.483827113 +0000 UTC m=+22.919480292" watchObservedRunningTime="2026-07-06 20:24:20.484453414 +0000 UTC m=+22.920106592"
Jul 06 20:24:20.506726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:20.506680    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lzr7s" podStartSLOduration=3.639994133 podStartE2EDuration="22.506661979s" totalImagesPullingTime="18.866667846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:20.505858674 +0000 UTC m=+22.941511872" watchObservedRunningTime="2026-07-06 20:24:20.506661979 +0000 UTC m=+22.942315157"
Jul 06 20:24:21.169271 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.169235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:21.169466 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.169306    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:21.169466 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.169411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:21.169466 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:21.169421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:21.169573 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:21.169513    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:21.169604 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:21.169582    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:21.348959 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.348885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9rlj" event={"ID":"32bb181f-c8d7-466b-89ab-810903b46c16","Type":"ContainerStarted","Data":"97fcb2b420630997c23d63b660c9fc8c6ca1e19e832e0115cc03b3ec70a8c724"}
Jul 06 20:24:21.351722 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.351689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"b18f6d1faad616f96dd6277e6fd0f71ef4c4ccd9b49b9887fab65cd9735130e9"}
Jul 06 20:24:21.351877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.351769    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"4b9d03f9a4dcd6f2f1628d665ab8df07027bbb157cf60b3442f889494116b477"}
Jul 06 20:24:21.351877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.351810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"6899e20efec99af68234e32a1deb9d4c3d2936bf594e31b6bd9185e8fee5b11f"}
Jul 06 20:24:21.351877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.351840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"19ee6890217940f9bea55ec410cf9dbf5f0553c0fb2620b463c7d05d444d16b9"}
Jul 06 20:24:21.351877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.351875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"cbcce75ac0191433949235a9eace3ac07a1f7d9ed28b468acf00af3040d04c3b"}
Jul 06 20:24:21.353171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.353147    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="acf1c371c94a8d07f2747e94ad8c831807f236f6c40cd503a587a881a345f7bf" exitCode=0
Jul 06 20:24:21.353271 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.353248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"acf1c371c94a8d07f2747e94ad8c831807f236f6c40cd503a587a881a345f7bf"}
Jul 06 20:24:21.365195 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.365142    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z9rlj" podStartSLOduration=4.497076682 podStartE2EDuration="23.365127122s" totalImagesPullingTime="18.86805044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:21.365041196 +0000 UTC m=+23.800694373" watchObservedRunningTime="2026-07-06 20:24:21.365127122 +0000 UTC m=+23.800780300"
Jul 06 20:24:21.500850 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:21.500827    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 20:24:22.052536 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:22.052418    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:24:21.500843025Z","UUID":"f5b9edd0-f689-44c2-b637-6a9ea8361279","Handler":null,"Name":"","Endpoint":""}
Jul 06 20:24:22.054375 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:22.054337    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 20:24:22.054512 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:22.054401    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 20:24:22.358384 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:22.358287    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r" event={"ID":"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02","Type":"ContainerStarted","Data":"d1bd9b339a9380661e3c5fe53676601a92305ad6c26c132d4a0df8947740fa82"}
Jul 06 20:24:23.169628 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.169551    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:23.169814 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.169641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:23.169814 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.169657    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:23.169814 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:23.169762    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:23.169977 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:23.169907    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:23.170059 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:23.170031    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:23.365347 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.365130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"0d00c8533ac329a5eb5db002eddc21e6336a381f4b95cf047c92ab0898d59bf8"}
Jul 06 20:24:23.367690 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.367655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r" event={"ID":"a8f41a4f-eff9-4a97-a01f-7dcf1b45ae02","Type":"ContainerStarted","Data":"8e5aa020575289dc1500130fd11a108558aedbf98b80f2e4760d925b8752fead"}
Jul 06 20:24:23.386957 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:23.386892    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fww8r" podStartSLOduration=4.447654581 podStartE2EDuration="25.386871412s" totalImagesPullingTime="20.939216831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:23.386451767 +0000 UTC m=+25.822104946" watchObservedRunningTime="2026-07-06 20:24:23.386871412 +0000 UTC m=+25.822524591"
Jul 06 20:24:25.129096 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.129059    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:25.129990 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.129969    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:25.169368 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.169321    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:25.169527 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.169450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:25.169527 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:25.169459    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:25.169527 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.169485    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:25.169655 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:25.169577    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:25.169697 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:25.169674    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:25.371820 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.371790    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:25.372266 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:25.372250    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rnj5t"
Jul 06 20:24:26.377651 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.377447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" event={"ID":"d2f688e8-2ce8-414a-a25a-3072bd702ed3","Type":"ContainerStarted","Data":"6b73a79baffe7dbe0bf20d26a87686247312d3f77f8c19e536a98c5032d7b609"}
Jul 06 20:24:26.378594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.377714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:26.378594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.377769    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:26.378594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.377807    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:26.379571 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.379548    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="0ea79edcb2054ca6349d5779c80cfd9825e7d9ebc1678f0363ef280b00995701" exitCode=0
Jul 06 20:24:26.379991 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.379941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"0ea79edcb2054ca6349d5779c80cfd9825e7d9ebc1678f0363ef280b00995701"}
Jul 06 20:24:26.394920 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.394890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:26.395077 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.395033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:26.408949 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:26.408898    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4" podStartSLOduration=9.476418707 podStartE2EDuration="28.40888366s" totalImagesPullingTime="18.932464953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:26.408007531 +0000 UTC m=+28.843660709" watchObservedRunningTime="2026-07-06 20:24:26.40888366 +0000 UTC m=+28.844536838"
Jul 06 20:24:27.169939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.169908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:27.169939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.169938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:27.170184 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.169909    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:27.170184 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.170054    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:27.170272 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.170205    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:27.170313 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.170281    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:27.384691 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.384660    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjskn"]
Jul 06 20:24:27.385190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.384765    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:27.385190 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.384893    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:27.388875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.388834    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd72t"]
Jul 06 20:24:27.389027 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.388983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:27.389180 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.389102    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:27.389395 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.389378    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4vxb4"]
Jul 06 20:24:27.389490 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:27.389446    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:27.389548 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:27.389533    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:28.385469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:28.385265    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="bb1a965e9767c75e6428439e804fb8d88f81dc0fa4b8fdc5868471f48f414edf" exitCode=0
Jul 06 20:24:28.385920 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:28.385347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"bb1a965e9767c75e6428439e804fb8d88f81dc0fa4b8fdc5868471f48f414edf"}
Jul 06 20:24:29.169224 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:29.169189    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:29.169413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:29.169239    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:29.169413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:29.169239    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:29.169413 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:29.169309    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:29.169544 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:29.169450    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:29.169544 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:29.169526    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:30.393102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:30.393064    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="a0e43baa0de488488d0ac7bfa5404cb4a3accc657ea32b83fcc8e1aee4ac779a" exitCode=0
Jul 06 20:24:30.393102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:30.393113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"a0e43baa0de488488d0ac7bfa5404cb4a3accc657ea32b83fcc8e1aee4ac779a"}
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.169570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.169598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.169598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.169721    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bd72t" podUID="b5c4cadc-ea3b-4d5f-92e8-549cf93d3119"
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.169798    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4vxb4" podUID="58bc6659-372c-43bd-880a-212bef2d9224"
Jul 06 20:24:31.170092 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.169875    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjskn" podUID="88356ccd-ae8a-43d7-b046-5d0612d50d08"
Jul 06 20:24:31.731839 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.731801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:31.732333 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.731845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:31.732333 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.731965    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:31.732333 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.732023    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret podName:88356ccd-ae8a-43d7-b046-5d0612d50d08 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.732010091 +0000 UTC m=+66.167663250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret") pod "global-pull-secret-syncer-zjskn" (UID: "88356ccd-ae8a-43d7-b046-5d0612d50d08") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:24:31.732333 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.731965    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:31.732333 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.732094    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.732082774 +0000 UTC m=+66.167735946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:24:31.833078 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:31.833034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:31.833271 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.833192    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:24:31.833271 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.833222    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:24:31.833271 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.833235    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6k8tw for pod openshift-network-diagnostics/network-check-target-4vxb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:31.833453 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:31.833305    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw podName:58bc6659-372c-43bd-880a-212bef2d9224 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.83328247 +0000 UTC m=+66.268935642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k8tw" (UniqueName: "kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw") pod "network-check-target-4vxb4" (UID: "58bc6659-372c-43bd-880a-212bef2d9224") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:24:32.795370 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.795322    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-229.ec2.internal" event="NodeReady"
Jul 06 20:24:32.795886 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.795514    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 20:24:32.850010 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.849879    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-776j4"]
Jul 06 20:24:32.852074 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.852043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wcnk6"]
Jul 06 20:24:32.852227 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.852199    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:32.854371 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.854338    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:32.854916 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.854889    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 20:24:32.855030 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.854950    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mqhkz\""
Jul 06 20:24:32.855030 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.854970    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 20:24:32.856519 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.856397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 20:24:32.856626 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.856616    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 20:24:32.857180 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.857152    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gmpj7\""
Jul 06 20:24:32.857278 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.857153    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 20:24:32.862175 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.862144    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcnk6"]
Jul 06 20:24:32.866918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.866891    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-776j4"]
Jul 06 20:24:32.941088 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2efabbef-7590-4061-b1d8-cbc835369e8c-cert\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:32.941088 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6b28010-18c1-4f51-80d8-f0c5383f791c-tmp-dir\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:32.941317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b28010-18c1-4f51-80d8-f0c5383f791c-config-volume\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:32.941317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgfzh\" (UniqueName: \"kubernetes.io/projected/2efabbef-7590-4061-b1d8-cbc835369e8c-kube-api-access-dgfzh\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:32.941317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wb7d\" (UniqueName: \"kubernetes.io/projected/a6b28010-18c1-4f51-80d8-f0c5383f791c-kube-api-access-8wb7d\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:32.941317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:32.941208    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.042587 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgfzh\" (UniqueName: \"kubernetes.io/projected/2efabbef-7590-4061-b1d8-cbc835369e8c-kube-api-access-dgfzh\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:33.042778 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wb7d\" (UniqueName: \"kubernetes.io/projected/a6b28010-18c1-4f51-80d8-f0c5383f791c-kube-api-access-8wb7d\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.042778 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.042778 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:33.042739    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:33.042908 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2efabbef-7590-4061-b1d8-cbc835369e8c-cert\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:33.042908 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:33.042801    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:24:33.542781706 +0000 UTC m=+35.978434875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:33.042908 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6b28010-18c1-4f51-80d8-f0c5383f791c-tmp-dir\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.042908 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.042852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b28010-18c1-4f51-80d8-f0c5383f791c-config-volume\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.043217 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.043196    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6b28010-18c1-4f51-80d8-f0c5383f791c-tmp-dir\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.043593 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.043473    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6b28010-18c1-4f51-80d8-f0c5383f791c-config-volume\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.047793 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.047617    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2efabbef-7590-4061-b1d8-cbc835369e8c-cert\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:33.057222 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.057192    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wb7d\" (UniqueName: \"kubernetes.io/projected/a6b28010-18c1-4f51-80d8-f0c5383f791c-kube-api-access-8wb7d\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.057395 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.057265    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgfzh\" (UniqueName: \"kubernetes.io/projected/2efabbef-7590-4061-b1d8-cbc835369e8c-kube-api-access-dgfzh\") pod \"ingress-canary-wcnk6\" (UID: \"2efabbef-7590-4061-b1d8-cbc835369e8c\") " pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:33.169414 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.169378    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:24:33.169414 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.169407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:24:33.169687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.169588    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:24:33.172050 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcnk6"
Jul 06 20:24:33.172204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172139    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 20:24:33.172204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172177    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 20:24:33.172204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172187    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 20:24:33.172381 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172294    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 20:24:33.172587 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172566    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hhd9j\""
Jul 06 20:24:33.172706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.172566    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z7zd8\""
Jul 06 20:24:33.318690 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.318654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcnk6"]
Jul 06 20:24:33.323137 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:33.323105    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efabbef_7590_4061_b1d8_cbc835369e8c.slice/crio-47cc9cb6a06886695e8bdd60772bb065c1d7836288375b922fe9240db4cd48fa WatchSource:0}: Error finding container 47cc9cb6a06886695e8bdd60772bb065c1d7836288375b922fe9240db4cd48fa: Status 404 returned error can't find the container with id 47cc9cb6a06886695e8bdd60772bb065c1d7836288375b922fe9240db4cd48fa
Jul 06 20:24:33.401609 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.401570    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcnk6" event={"ID":"2efabbef-7590-4061-b1d8-cbc835369e8c","Type":"ContainerStarted","Data":"47cc9cb6a06886695e8bdd60772bb065c1d7836288375b922fe9240db4cd48fa"}
Jul 06 20:24:33.546241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:33.546114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:33.546409 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:33.546264    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:33.546409 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:33.546336    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:24:34.546318002 +0000 UTC m=+36.981971177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:34.556229 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:34.555601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:34.556229 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:34.555794    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:34.556229 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:34.555863    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:24:36.555845158 +0000 UTC m=+38.991498318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:36.573831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:36.573795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:36.574243 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:36.573954    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:36.574243 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:36.574019    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:24:40.574003909 +0000 UTC m=+43.009657064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:37.413042 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:37.412813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcnk6" event={"ID":"2efabbef-7590-4061-b1d8-cbc835369e8c","Type":"ContainerStarted","Data":"f33881bc03a6d790b3cd4e8b21a979960f4232fca3474203ddb1edeaa7b855e3"}
Jul 06 20:24:37.415477 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:37.415406    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="2ce70ad32131f1a49e4d3f11c5a57d0ff2008aedd3528d9094d8e53cefff676a" exitCode=0
Jul 06 20:24:37.415477 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:37.415442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"2ce70ad32131f1a49e4d3f11c5a57d0ff2008aedd3528d9094d8e53cefff676a"}
Jul 06 20:24:37.430481 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:37.430438    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wcnk6" podStartSLOduration=1.865702529 podStartE2EDuration="5.430422782s" totalImagesPullingTime="3.564720253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:37.430116485 +0000 UTC m=+39.865769664" watchObservedRunningTime="2026-07-06 20:24:37.430422782 +0000 UTC m=+39.866075994"
Jul 06 20:24:38.420858 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:38.420818    2571 generic.go:356] "Generic (PLEG): container finished" podID="49e6b067-73be-4ff3-8d9f-b3420fdc0189" containerID="12e1dee5ec4e6b8386aca4e2e7757b6bc58cd3ad2093894c85efdb2728318fb0" exitCode=0
Jul 06 20:24:38.421402 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:38.420901    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerDied","Data":"12e1dee5ec4e6b8386aca4e2e7757b6bc58cd3ad2093894c85efdb2728318fb0"}
Jul 06 20:24:39.426651 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:39.426612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" event={"ID":"49e6b067-73be-4ff3-8d9f-b3420fdc0189","Type":"ContainerStarted","Data":"6a2918a34262e49f9b443d2ee197163f77d8ed1378036bfb835fd1b579c7b6d8"}
Jul 06 20:24:39.453418 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:39.453294    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9vg6w" podStartSLOduration=9.826477761 podStartE2EDuration="41.453275251s" totalImagesPullingTime="31.62679749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:39.450886525 +0000 UTC m=+41.886539703" watchObservedRunningTime="2026-07-06 20:24:39.453275251 +0000 UTC m=+41.888928428"
Jul 06 20:24:40.602444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:40.602401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:40.602803 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:40.602569    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:40.602803 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:40.602660    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:24:48.602634919 +0000 UTC m=+51.038288089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:48.660745 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:48.660697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:24:48.661317 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:48.660833    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:24:48.661317 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:48.660918    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:25:04.660896765 +0000 UTC m=+67.096549938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:24:56.064940 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.064905    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"]
Jul 06 20:24:56.067218 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.067200    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.070454 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.070429    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 20:24:56.070606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.070486    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 20:24:56.072726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.072699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 20:24:56.072863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.072706    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fp6qd\""
Jul 06 20:24:56.073018 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.072994    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 20:24:56.073521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.073505    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c8f695bc9-s6z6g"]
Jul 06 20:24:56.075600 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.075582    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.079917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.079850    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 20:24:56.080077 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.079944    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 20:24:56.080077 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.080038    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 20:24:56.080260 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.080189    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 20:24:56.080349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.080269    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 20:24:56.080349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.080283    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4bf24\""
Jul 06 20:24:56.080454 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.080418    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 20:24:56.093213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.093182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"]
Jul 06 20:24:56.093869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.093848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8f695bc9-s6z6g"]
Jul 06 20:24:56.111868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.111830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.112037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.111876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8wvl\" (UniqueName: \"kubernetes.io/projected/6c996b68-2495-4b5a-8a1b-e3046d5023ca-kube-api-access-v8wvl\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.112037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.111946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-default-certificate\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.112037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.111988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-stats-auth\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.112037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.112009    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rlc\" (UniqueName: \"kubernetes.io/projected/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-kube-api-access-s2rlc\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.112190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.112072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.112190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.112088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.112190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.112164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c996b68-2495-4b5a-8a1b-e3046d5023ca-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.165860 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.165831    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-97vdg"]
Jul 06 20:24:56.167780 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.167759    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"]
Jul 06 20:24:56.167891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.167879    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.169611 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.169592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.171966 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.171947    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 20:24:56.176697 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176672    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-md7s7\""
Jul 06 20:24:56.176697 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176686    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 20:24:56.176868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7fj69\""
Jul 06 20:24:56.176868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176746    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:24:56.176868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176692    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 20:24:56.177023 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176910    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 20:24:56.177023 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.176912    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 20:24:56.177194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.177178    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 20:24:56.182252 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.182229    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 20:24:56.185786 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.185762    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-97vdg"]
Jul 06 20:24:56.203722 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.203683    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"]
Jul 06 20:24:56.213170 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.213170 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8wvl\" (UniqueName: \"kubernetes.io/projected/6c996b68-2495-4b5a-8a1b-e3046d5023ca-kube-api-access-v8wvl\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.213416 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-default-certificate\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.213416 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e38a63b-8a3c-48be-80f6-de0d3f154f96-serving-cert\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.213416 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.213309    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:56.213416 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-stats-auth\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.213738 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwk4c\" (UniqueName: \"kubernetes.io/projected/2e38a63b-8a3c-48be-80f6-de0d3f154f96-kube-api-access-pwk4c\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.213818 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rlc\" (UniqueName: \"kubernetes.io/projected/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-kube-api-access-s2rlc\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.213870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.213923 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.213978 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.213922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.214226 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.214206    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:24:56.214333 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.214255    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-snapshots\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.214333 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.214290    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:56.714262018 +0000 UTC m=+59.149915196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:24:56.214470 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.214335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.214653 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.214467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c996b68-2495-4b5a-8a1b-e3046d5023ca-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.214732 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.214680    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.214918 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.214891    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:24:56.714867629 +0000 UTC m=+59.150520799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:56.214987 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.214964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tshmk\" (UniqueName: \"kubernetes.io/projected/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-kube-api-access-tshmk\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.215307 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.215091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-tmp\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.217153 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.216837    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:56.716797102 +0000 UTC m=+59.152450277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:24:56.218293 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.217956    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c996b68-2495-4b5a-8a1b-e3046d5023ca-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.219600 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.219578    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-stats-auth\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.219691 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.219582    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-default-certificate\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.225781 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.225751    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rlc\" (UniqueName: \"kubernetes.io/projected/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-kube-api-access-s2rlc\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.227346 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.227323    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8wvl\" (UniqueName: \"kubernetes.io/projected/6c996b68-2495-4b5a-8a1b-e3046d5023ca-kube-api-access-v8wvl\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.317099 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.316998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-snapshots\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317099 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317099 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.317099 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tshmk\" (UniqueName: \"kubernetes.io/projected/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-kube-api-access-tshmk\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.317528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-tmp\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317528 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.317308    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:24:56.317528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e38a63b-8a3c-48be-80f6-de0d3f154f96-serving-cert\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317528 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.317429    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:56.817407173 +0000 UTC m=+59.253060344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:24:56.317528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317531    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-tmp\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317855 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwk4c\" (UniqueName: \"kubernetes.io/projected/2e38a63b-8a3c-48be-80f6-de0d3f154f96-kube-api-access-pwk4c\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317855 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.317855 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.317799    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2e38a63b-8a3c-48be-80f6-de0d3f154f96-snapshots\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.318064 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.318044    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.318116 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.318090    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e38a63b-8a3c-48be-80f6-de0d3f154f96-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.319664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.319645    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e38a63b-8a3c-48be-80f6-de0d3f154f96-serving-cert\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.326259 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.326235    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tshmk\" (UniqueName: \"kubernetes.io/projected/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-kube-api-access-tshmk\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.326388 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.326239    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwk4c\" (UniqueName: \"kubernetes.io/projected/2e38a63b-8a3c-48be-80f6-de0d3f154f96-kube-api-access-pwk4c\") pod \"insights-operator-5c847dcfc4-97vdg\" (UID: \"2e38a63b-8a3c-48be-80f6-de0d3f154f96\") " pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.478564 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.478529    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg"
Jul 06 20:24:56.618780 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.618746    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-97vdg"]
Jul 06 20:24:56.621758 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:24:56.621716    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e38a63b_8a3c_48be_80f6_de0d3f154f96.slice/crio-f41c01218e9bf61ca999cc6baee4f88ccd2abb3f7e27a4ac5ff7804e0c067ce8 WatchSource:0}: Error finding container f41c01218e9bf61ca999cc6baee4f88ccd2abb3f7e27a4ac5ff7804e0c067ce8: Status 404 returned error can't find the container with id f41c01218e9bf61ca999cc6baee4f88ccd2abb3f7e27a4ac5ff7804e0c067ce8
Jul 06 20:24:56.720714 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.720670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:56.720900 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.720744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.720900 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.720828    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:56.720900 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.720846    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:57.720832528 +0000 UTC m=+60.156485683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:24:56.721029 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.720916    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:24:57.720899276 +0000 UTC m=+60.156552438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:56.721029 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.720943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:56.721101 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.721056    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:24:56.721141 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.721096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:57.721085512 +0000 UTC m=+60.156738677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:24:56.821804 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:56.821752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:56.821924 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.821897    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:24:56.821978 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:56.821967    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:57.821945856 +0000 UTC m=+60.257599015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:24:57.472799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:57.472762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg" event={"ID":"2e38a63b-8a3c-48be-80f6-de0d3f154f96","Type":"ContainerStarted","Data":"f41c01218e9bf61ca999cc6baee4f88ccd2abb3f7e27a4ac5ff7804e0c067ce8"}
Jul 06 20:24:57.729396 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:57.729282    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:57.729396 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:57.729324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:57.729402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.729485    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:59.729464366 +0000 UTC m=+62.165117522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.729507    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.729554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:24:59.729542984 +0000 UTC m=+62.165196140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.729508    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:24:57.729606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.729583    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:24:59.729576712 +0000 UTC m=+62.165229868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:24:57.830313 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:57.830268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:57.830501 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.830443    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:24:57.830541 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:57.830514    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:59.830499324 +0000 UTC m=+62.266152480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:24:58.408804 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:58.408774    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jtcx4"
Jul 06 20:24:59.745722 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:59.745623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:59.745722 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:59.745663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.745768    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.745787    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.745766204 +0000 UTC m=+66.181419378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.745811    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.745797806 +0000 UTC m=+66.181450980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:59.745901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.746037    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:59.746265 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.746096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.746081498 +0000 UTC m=+66.181734654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:24:59.846707 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:24:59.846666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:24:59.846862 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.846807    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:24:59.846901 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:24:59.846874    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:03.84685587 +0000 UTC m=+66.282509034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:25:00.480688 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.480652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg" event={"ID":"2e38a63b-8a3c-48be-80f6-de0d3f154f96","Type":"ContainerStarted","Data":"ed82e5429a345d0cf17c9706d625b9f0c5f9643a3f8b32563f811c0bcbcabdcc"}
Jul 06 20:25:00.753375 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.753260    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg" podStartSLOduration=1.9670033949999999 podStartE2EDuration="4.753243068s" totalImagesPullingTime="2.786239673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:00.497240092 +0000 UTC m=+62.932893271" watchObservedRunningTime="2026-07-06 20:25:00.753243068 +0000 UTC m=+63.188896245"
Jul 06 20:25:00.754607 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.754574    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pc9qm"]
Jul 06 20:25:00.756665 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.756649    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.761927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.761901    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 20:25:00.762153 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.761913    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 20:25:00.762285 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.761948    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k6n8v\""
Jul 06 20:25:00.784410 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.784376    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pc9qm"]
Jul 06 20:25:00.855556 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.855519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.855756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.855581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.855756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.855629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0005742e-a52a-4a43-8919-32878acc6367-data-volume\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.855756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.855728    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srzvm\" (UniqueName: \"kubernetes.io/projected/0005742e-a52a-4a43-8919-32878acc6367-kube-api-access-srzvm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.855920 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.855763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0005742e-a52a-4a43-8919-32878acc6367-crio-socket\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srzvm\" (UniqueName: \"kubernetes.io/projected/0005742e-a52a-4a43-8919-32878acc6367-kube-api-access-srzvm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956293    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0005742e-a52a-4a43-8919-32878acc6367-crio-socket\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956429    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0005742e-a52a-4a43-8919-32878acc6367-crio-socket\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0005742e-a52a-4a43-8919-32878acc6367-data-volume\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:00.956472    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:00.956521 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:00.956519    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:25:00.956717 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:00.956535    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:01.456515963 +0000 UTC m=+63.892169135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:00.956717 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:00.956568    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:01.456550179 +0000 UTC m=+63.892203349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : configmap "kube-rbac-proxy" not found
Jul 06 20:25:00.956814 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.956795    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0005742e-a52a-4a43-8919-32878acc6367-data-volume\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:00.968724 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:00.968689    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srzvm\" (UniqueName: \"kubernetes.io/projected/0005742e-a52a-4a43-8919-32878acc6367-kube-api-access-srzvm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:01.464716 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.464680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:01.464891 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:01.464810    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:25:01.464891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.464854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:01.464891 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:01.464874    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:02.464855905 +0000 UTC m=+64.900509084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : configmap "kube-rbac-proxy" not found
Jul 06 20:25:01.465015 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:01.464943    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:01.465015 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:01.464997    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:02.464985006 +0000 UTC m=+64.900638163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:01.954487 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.954455    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"]
Jul 06 20:25:01.956551 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.956535    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:01.959030 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.959007    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 20:25:01.959263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.959239    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 20:25:01.959338 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.959283    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 20:25:01.959965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.959949    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6mvqq\""
Jul 06 20:25:01.959965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.959957    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:25:01.966223 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:01.966190    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"]
Jul 06 20:25:02.069824 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.069789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzfs\" (UniqueName: \"kubernetes.io/projected/93b7f44d-300d-4052-9369-dd63cfc2c9e8-kube-api-access-zhzfs\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.070014 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.069980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93b7f44d-300d-4052-9369-dd63cfc2c9e8-config\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.070069 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.070053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7f44d-300d-4052-9369-dd63cfc2c9e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.171097 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.171063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93b7f44d-300d-4052-9369-dd63cfc2c9e8-config\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.171262 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.171163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7f44d-300d-4052-9369-dd63cfc2c9e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.171262 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.171193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzfs\" (UniqueName: \"kubernetes.io/projected/93b7f44d-300d-4052-9369-dd63cfc2c9e8-kube-api-access-zhzfs\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.171689 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.171669    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/93b7f44d-300d-4052-9369-dd63cfc2c9e8-config\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.173432 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.173409    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/93b7f44d-300d-4052-9369-dd63cfc2c9e8-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.179310 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.179284    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzfs\" (UniqueName: \"kubernetes.io/projected/93b7f44d-300d-4052-9369-dd63cfc2c9e8-kube-api-access-zhzfs\") pod \"service-ca-operator-5d46d9ffd4-z94dm\" (UID: \"93b7f44d-300d-4052-9369-dd63cfc2c9e8\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.266165 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.266083    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"
Jul 06 20:25:02.390768 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.390736    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm"]
Jul 06 20:25:02.395616 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:02.395580    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b7f44d_300d_4052_9369_dd63cfc2c9e8.slice/crio-10f092c7e8ec8653e20af59c664c1c6c01f6440ca8f52c1fd17f0e120756f4e5 WatchSource:0}: Error finding container 10f092c7e8ec8653e20af59c664c1c6c01f6440ca8f52c1fd17f0e120756f4e5: Status 404 returned error can't find the container with id 10f092c7e8ec8653e20af59c664c1c6c01f6440ca8f52c1fd17f0e120756f4e5
Jul 06 20:25:02.474117 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.474079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:02.474276 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.474139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:02.474276 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:02.474233    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:02.474276 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:02.474247    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:25:02.474398 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:02.474302    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:04.474286601 +0000 UTC m=+66.909939757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:02.474398 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:02.474319    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:04.474311111 +0000 UTC m=+66.909964267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : configmap "kube-rbac-proxy" not found
Jul 06 20:25:02.487152 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.487118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm" event={"ID":"93b7f44d-300d-4052-9369-dd63cfc2c9e8","Type":"ContainerStarted","Data":"10f092c7e8ec8653e20af59c664c1c6c01f6440ca8f52c1fd17f0e120756f4e5"}
Jul 06 20:25:02.547617 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:02.547546    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzr7s_e0062ec7-3059-4fbf-81d7-446b387d34e3/dns-node-resolver/0.log"
Jul 06 20:25:03.785488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.785453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.785522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.785560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.785581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.785626    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.785666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.785720    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:25:11.785689301 +0000 UTC m=+74.221342458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.785744    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.785793    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:11.785773819 +0000 UTC m=+74.221426982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:25:03.785998 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.785814    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:11.785807761 +0000 UTC m=+74.221460921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:25:03.788241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.788216    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 20:25:03.788387 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.788223    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 20:25:03.796280 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.796251    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 20:25:03.796446 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.796327    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs podName:b5c4cadc-ea3b-4d5f-92e8-549cf93d3119 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:07.796307542 +0000 UTC m=+130.231960701 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs") pod "network-metrics-daemon-bd72t" (UID: "b5c4cadc-ea3b-4d5f-92e8-549cf93d3119") : secret "metrics-daemon-secret" not found
Jul 06 20:25:03.798796 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.798766    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88356ccd-ae8a-43d7-b046-5d0612d50d08-original-pull-secret\") pod \"global-pull-secret-syncer-zjskn\" (UID: \"88356ccd-ae8a-43d7-b046-5d0612d50d08\") " pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:25:03.886520 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.886480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:25:03.886718 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.886624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:25:03.886791 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.886756    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:25:03.886842 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:03.886827    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:11.886806654 +0000 UTC m=+74.322459825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:25:03.889295 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.889266    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 20:25:03.899005 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.898972    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 20:25:03.910050 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.910023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k8tw\" (UniqueName: \"kubernetes.io/projected/58bc6659-372c-43bd-880a-212bef2d9224-kube-api-access-6k8tw\") pod \"network-check-target-4vxb4\" (UID: \"58bc6659-372c-43bd-880a-212bef2d9224\") " pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:25:03.949784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:03.949756    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sx97n_6cf26b5d-764d-43a8-941b-eab56add0bc1/node-ca/0.log"
Jul 06 20:25:04.091772 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.091678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjskn"
Jul 06 20:25:04.107597 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.107570    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hhd9j\""
Jul 06 20:25:04.115671 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.115638    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:25:04.234604 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.234566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjskn"]
Jul 06 20:25:04.237769 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:04.237734    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88356ccd_ae8a_43d7_b046_5d0612d50d08.slice/crio-affb71591aaabe19507e55f223fbb97affd56e9f5a05f7eb19e3f6624e94c2fb WatchSource:0}: Error finding container affb71591aaabe19507e55f223fbb97affd56e9f5a05f7eb19e3f6624e94c2fb: Status 404 returned error can't find the container with id affb71591aaabe19507e55f223fbb97affd56e9f5a05f7eb19e3f6624e94c2fb
Jul 06 20:25:04.268867 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.268838    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4vxb4"]
Jul 06 20:25:04.271748 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:04.271718    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bc6659_372c_43bd_880a_212bef2d9224.slice/crio-a2afbc79101049c87883a75e76359b719950688e8da2ede4b6f5e3a1b4a6719f WatchSource:0}: Error finding container a2afbc79101049c87883a75e76359b719950688e8da2ede4b6f5e3a1b4a6719f: Status 404 returned error can't find the container with id a2afbc79101049c87883a75e76359b719950688e8da2ede4b6f5e3a1b4a6719f
Jul 06 20:25:04.491437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.491409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:04.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.491458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:04.491606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.491527    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:25:04.491606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.491550    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:04.491606 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.491600    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:08.491582709 +0000 UTC m=+70.927235882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : configmap "kube-rbac-proxy" not found
Jul 06 20:25:04.491797 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.491615    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:08.491609734 +0000 UTC m=+70.927262890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:04.493519 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.493490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4vxb4" event={"ID":"58bc6659-372c-43bd-880a-212bef2d9224","Type":"ContainerStarted","Data":"a2afbc79101049c87883a75e76359b719950688e8da2ede4b6f5e3a1b4a6719f"}
Jul 06 20:25:04.494484 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.494463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjskn" event={"ID":"88356ccd-ae8a-43d7-b046-5d0612d50d08","Type":"ContainerStarted","Data":"affb71591aaabe19507e55f223fbb97affd56e9f5a05f7eb19e3f6624e94c2fb"}
Jul 06 20:25:04.693494 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.693462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:04.693675 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.693647    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:25:04.693743 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:04.693723    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls podName:a6b28010-18c1-4f51-80d8-f0c5383f791c nodeName:}" failed. No retries permitted until 2026-07-06 20:25:36.693701932 +0000 UTC m=+99.129355091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls") pod "dns-default-776j4" (UID: "a6b28010-18c1-4f51-80d8-f0c5383f791c") : secret "dns-default-metrics-tls" not found
Jul 06 20:25:04.757385 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:04.757242    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcnk6_2efabbef-7590-4061-b1d8-cbc835369e8c/serve-healthcheck-canary/0.log"
Jul 06 20:25:06.399635 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.399603    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"]
Jul 06 20:25:06.417185 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.417014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"]
Jul 06 20:25:06.417185 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.417140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:06.419950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.419707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 20:25:06.419950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.419746    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 20:25:06.419950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.419719    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n4qj7\""
Jul 06 20:25:06.502906 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.502862    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm" event={"ID":"93b7f44d-300d-4052-9369-dd63cfc2c9e8","Type":"ContainerStarted","Data":"7976faf5a6a97efaaf688cd098d10729374e15e51925667c38bb031a11d90aa1"}
Jul 06 20:25:06.510438 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.510407    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:06.510606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.510531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:06.522831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.522689    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm" podStartSLOduration=1.760335277 podStartE2EDuration="5.522669032s" totalImagesPullingTime="3.762333755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:06.521395214 +0000 UTC m=+68.957048390" watchObservedRunningTime="2026-07-06 20:25:06.522669032 +0000 UTC m=+68.958322212"
Jul 06 20:25:06.611630 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.611588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:06.611805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.611783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:06.612614 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:06.612148    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:06.612614 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:06.612226    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:07.112194332 +0000 UTC m=+69.547847492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:06.612614 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:06.612572    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:07.116285 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:07.116243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:07.116511 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:07.116437    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:07.116574 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:07.116510    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:08.116490674 +0000 UTC m=+70.552143886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:08.125768 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:08.125719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:08.126299 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.125875    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:08.126299 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.125956    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:10.12593547 +0000 UTC m=+72.561588625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:08.530411 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:08.530305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:08.530568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:08.530412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:08.530568 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.530495    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:08.530568 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.530525    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:25:08.530714 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.530580    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:16.530556808 +0000 UTC m=+78.966209967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:08.530714 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:08.530604    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:16.530593104 +0000 UTC m=+78.966246263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : configmap "kube-rbac-proxy" not found
Jul 06 20:25:09.515496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:09.515462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjskn" event={"ID":"88356ccd-ae8a-43d7-b046-5d0612d50d08","Type":"ContainerStarted","Data":"35a33e3f50daac080e30dfcbbb332e6177d359429e6e4af18843ecfb54b17085"}
Jul 06 20:25:09.516900 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:09.516874    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4vxb4" event={"ID":"58bc6659-372c-43bd-880a-212bef2d9224","Type":"ContainerStarted","Data":"45134e151ce6938684d205912a99b2bbb993cacf12a064a787a58ec4baf2b192"}
Jul 06 20:25:09.517036 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:09.517017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:25:09.535845 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:09.535795    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zjskn" podStartSLOduration=66.746175463 podStartE2EDuration="1m11.535778375s" totalImagesPullingTime="4.789602912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:09.534758422 +0000 UTC m=+71.970411594" watchObservedRunningTime="2026-07-06 20:25:09.535778375 +0000 UTC m=+71.971431625"
Jul 06 20:25:09.557470 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:09.557423    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4vxb4" podStartSLOduration=66.804628307 podStartE2EDuration="1m11.557409151s" totalImagesPullingTime="4.752780844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:09.557313795 +0000 UTC m=+71.992966977" watchObservedRunningTime="2026-07-06 20:25:09.557409151 +0000 UTC m=+71.993062329"
Jul 06 20:25:10.145622 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:10.145584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:10.145901 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:10.145745    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:10.145901 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:10.145813    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:14.145796236 +0000 UTC m=+76.581449392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:11.859784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:11.859729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:25:11.859784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:11.859795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:11.859862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.859903    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.859948    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.859980    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:27.859964221 +0000 UTC m=+90.295617381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : configmap references non-existent config key: service-ca.crt
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.859997    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs podName:c462e4a5-cd4e-4c62-9806-9b1f6af5435b nodeName:}" failed. No retries permitted until 2026-07-06 20:25:27.859990696 +0000 UTC m=+90.295643852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs") pod "router-default-c8f695bc9-s6z6g" (UID: "c462e4a5-cd4e-4c62-9806-9b1f6af5435b") : secret "router-metrics-certs-default" not found
Jul 06 20:25:11.860214 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.860009    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls podName:6c996b68-2495-4b5a-8a1b-e3046d5023ca nodeName:}" failed. No retries permitted until 2026-07-06 20:25:27.86000212 +0000 UTC m=+90.295655276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-hlsz7" (UID: "6c996b68-2495-4b5a-8a1b-e3046d5023ca") : secret "cluster-monitoring-operator-tls" not found
Jul 06 20:25:11.960441 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:11.960406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:25:11.960618 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.960557    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 20:25:11.960660 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:11.960627    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls podName:bddf89b8-3b0f-493f-ad0b-08fcd83fb611 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:27.960611051 +0000 UTC m=+90.396264206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-cqmtk" (UID: "bddf89b8-3b0f-493f-ad0b-08fcd83fb611") : secret "samples-operator-tls" not found
Jul 06 20:25:14.180720 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:14.180681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:14.181212 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:14.180888    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:14.181212 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:14.180978    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:22.18095497 +0000 UTC m=+84.616608132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:16.600831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:16.600795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:16.601317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:16.600866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:16.601317 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:16.600969    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:16.601317 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:16.601051    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls podName:0005742e-a52a-4a43-8919-32878acc6367 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:32.601030107 +0000 UTC m=+95.036683266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pc9qm" (UID: "0005742e-a52a-4a43-8919-32878acc6367") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:25:16.601502 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:16.601386    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0005742e-a52a-4a43-8919-32878acc6367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:22.254498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:22.254351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:22.254943 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:22.254505    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 20:25:22.254943 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:22.254584    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert podName:9a96b41f-e020-4fa2-b6b8-a07ae09d2124 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:38.254564919 +0000 UTC m=+100.690218094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-7vwcx" (UID: "9a96b41f-e020-4fa2-b6b8-a07ae09d2124") : secret "networking-console-plugin-cert" not found
Jul 06 20:25:27.902565 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.902516    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:27.903041 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.902589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:25:27.903041 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.902622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:27.903210 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.903187    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-service-ca-bundle\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:27.905000 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.904982    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c996b68-2495-4b5a-8a1b-e3046d5023ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-hlsz7\" (UID: \"6c996b68-2495-4b5a-8a1b-e3046d5023ca\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:25:27.905055 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:27.904997    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c462e4a5-cd4e-4c62-9806-9b1f6af5435b-metrics-certs\") pod \"router-default-c8f695bc9-s6z6g\" (UID: \"c462e4a5-cd4e-4c62-9806-9b1f6af5435b\") " pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:28.003770 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.003721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:25:28.006007 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.005979    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bddf89b8-3b0f-493f-ad0b-08fcd83fb611-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-cqmtk\" (UID: \"bddf89b8-3b0f-493f-ad0b-08fcd83fb611\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:25:28.179516 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.179436    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fp6qd\""
Jul 06 20:25:28.185692 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.185671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4bf24\""
Jul 06 20:25:28.187564 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.187547    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"
Jul 06 20:25:28.193916 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.193895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:28.286153 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.286114    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7fj69\""
Jul 06 20:25:28.294636 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.294580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"
Jul 06 20:25:28.325397 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.325345    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7"]
Jul 06 20:25:28.327827 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:28.327799    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c996b68_2495_4b5a_8a1b_e3046d5023ca.slice/crio-08646d9680cfd8872c5f6650f838b033f191061a0442c3a95aad7966234b596c WatchSource:0}: Error finding container 08646d9680cfd8872c5f6650f838b033f191061a0442c3a95aad7966234b596c: Status 404 returned error can't find the container with id 08646d9680cfd8872c5f6650f838b033f191061a0442c3a95aad7966234b596c
Jul 06 20:25:28.341411 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.341380    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c8f695bc9-s6z6g"]
Jul 06 20:25:28.345512 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:28.345430    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc462e4a5_cd4e_4c62_9806_9b1f6af5435b.slice/crio-91bc50951593ea71a65c8b3b23e74ec9178c0dd11400b7f4553b7d80ae1a1a82 WatchSource:0}: Error finding container 91bc50951593ea71a65c8b3b23e74ec9178c0dd11400b7f4553b7d80ae1a1a82: Status 404 returned error can't find the container with id 91bc50951593ea71a65c8b3b23e74ec9178c0dd11400b7f4553b7d80ae1a1a82
Jul 06 20:25:28.427473 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.427433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk"]
Jul 06 20:25:28.567370 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.567328    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7" event={"ID":"6c996b68-2495-4b5a-8a1b-e3046d5023ca","Type":"ContainerStarted","Data":"08646d9680cfd8872c5f6650f838b033f191061a0442c3a95aad7966234b596c"}
Jul 06 20:25:28.568474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.568445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk" event={"ID":"bddf89b8-3b0f-493f-ad0b-08fcd83fb611","Type":"ContainerStarted","Data":"c347ce4a605cbc5c72ae60f0d3f63ab9bdf7bd1f998d4b1c7da527a3c9c41e52"}
Jul 06 20:25:28.569947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.569923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8f695bc9-s6z6g" event={"ID":"c462e4a5-cd4e-4c62-9806-9b1f6af5435b","Type":"ContainerStarted","Data":"13829b818e19d573a8741e6165423cbdd9f3eef0281f60f89cdbf96de8d81594"}
Jul 06 20:25:28.570070 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.569962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c8f695bc9-s6z6g" event={"ID":"c462e4a5-cd4e-4c62-9806-9b1f6af5435b","Type":"ContainerStarted","Data":"91bc50951593ea71a65c8b3b23e74ec9178c0dd11400b7f4553b7d80ae1a1a82"}
Jul 06 20:25:28.592974 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:28.592907    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c8f695bc9-s6z6g" podStartSLOduration=32.592885899 podStartE2EDuration="32.592885899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:28.590925283 +0000 UTC m=+91.026578459" watchObservedRunningTime="2026-07-06 20:25:28.592885899 +0000 UTC m=+91.028539055"
Jul 06 20:25:29.194537 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:29.194503    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:29.197031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:29.197008    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:29.575456 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:29.575371    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:29.577125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:29.576890    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c8f695bc9-s6z6g"
Jul 06 20:25:31.584310 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:31.584220    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk" event={"ID":"bddf89b8-3b0f-493f-ad0b-08fcd83fb611","Type":"ContainerStarted","Data":"ad8bca87f5c7da1edbbed5dbe20bfb98683267c9575f13f87bca58151699ff15"}
Jul 06 20:25:31.584310 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:31.584278    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk" event={"ID":"bddf89b8-3b0f-493f-ad0b-08fcd83fb611","Type":"ContainerStarted","Data":"3904dc19b8994047026dd6a831446e5bd4724ee3c05961f1530adc9dec3ae2ef"}
Jul 06 20:25:31.585815 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:31.585791    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7" event={"ID":"6c996b68-2495-4b5a-8a1b-e3046d5023ca","Type":"ContainerStarted","Data":"1ced229564d6ee261fb914812f4070cbaf30764ff6b7a4eb38b401369acf936c"}
Jul 06 20:25:31.601935 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:31.601880    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-cqmtk" podStartSLOduration=32.921866225 podStartE2EDuration="35.601863479s" totalImagesPullingTime="2.679997254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:31.60112001 +0000 UTC m=+94.036773198" watchObservedRunningTime="2026-07-06 20:25:31.601863479 +0000 UTC m=+94.037516656"
Jul 06 20:25:31.621833 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:31.621777    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-hlsz7" podStartSLOduration=32.795902396 podStartE2EDuration="35.621759489s" totalImagesPullingTime="2.825857093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:31.620769908 +0000 UTC m=+94.056423084" watchObservedRunningTime="2026-07-06 20:25:31.621759489 +0000 UTC m=+94.057412664"
Jul 06 20:25:32.648278 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:32.648239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:32.652579 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:32.651871    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0005742e-a52a-4a43-8919-32878acc6367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pc9qm\" (UID: \"0005742e-a52a-4a43-8919-32878acc6367\") " pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:32.866152 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:32.866114    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pc9qm"
Jul 06 20:25:32.995895 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:32.995862    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pc9qm"]
Jul 06 20:25:32.998702 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:32.998670    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0005742e_a52a_4a43_8919_32878acc6367.slice/crio-c296854fcc8533ded1b50258d253df8a644420fdb3968e16dff6032c67ad8252 WatchSource:0}: Error finding container c296854fcc8533ded1b50258d253df8a644420fdb3968e16dff6032c67ad8252: Status 404 returned error can't find the container with id c296854fcc8533ded1b50258d253df8a644420fdb3968e16dff6032c67ad8252
Jul 06 20:25:33.600673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.600566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pc9qm" event={"ID":"0005742e-a52a-4a43-8919-32878acc6367","Type":"ContainerStarted","Data":"c296854fcc8533ded1b50258d253df8a644420fdb3968e16dff6032c67ad8252"}
Jul 06 20:25:33.686790 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.686376    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-trs6t"]
Jul 06 20:25:33.690841 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.690814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:33.701139 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.699998    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"]
Jul 06 20:25:33.701350 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.701328    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 20:25:33.701454 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.701408    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 20:25:33.701583 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.701329    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9qhsb\""
Jul 06 20:25:33.706480 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.706337    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:33.708728 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.708665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-trs6t"]
Jul 06 20:25:33.714989 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.714480    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vjk7f\""
Jul 06 20:25:33.714989 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.714779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 20:25:33.726450 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.726368    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"]
Jul 06 20:25:33.756652 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.756611    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dd8f243-603e-42f8-a5c8-00af5216009c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-28lsl\" (UID: \"7dd8f243-603e-42f8-a5c8-00af5216009c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:33.756922 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.756666    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpd2d\" (UniqueName: \"kubernetes.io/projected/30eeaa52-243c-4b47-8d1f-447e61ecd9f0-kube-api-access-fpd2d\") pod \"downloads-685bfb5f64-trs6t\" (UID: \"30eeaa52-243c-4b47-8d1f-447e61ecd9f0\") " pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:33.857617 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.857419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dd8f243-603e-42f8-a5c8-00af5216009c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-28lsl\" (UID: \"7dd8f243-603e-42f8-a5c8-00af5216009c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:33.857617 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.857473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpd2d\" (UniqueName: \"kubernetes.io/projected/30eeaa52-243c-4b47-8d1f-447e61ecd9f0-kube-api-access-fpd2d\") pod \"downloads-685bfb5f64-trs6t\" (UID: \"30eeaa52-243c-4b47-8d1f-447e61ecd9f0\") " pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:33.861129 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.861037    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dd8f243-603e-42f8-a5c8-00af5216009c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-28lsl\" (UID: \"7dd8f243-603e-42f8-a5c8-00af5216009c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:33.881204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.881168    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65cbbfc584-hgdtq"]
Jul 06 20:25:33.884851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.884825    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.889397 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.889373    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 20:25:33.895937 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.895909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zmkh5\""
Jul 06 20:25:33.897261 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.896226    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 20:25:33.898933 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.898909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 20:25:33.899044 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.898963    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpd2d\" (UniqueName: \"kubernetes.io/projected/30eeaa52-243c-4b47-8d1f-447e61ecd9f0-kube-api-access-fpd2d\") pod \"downloads-685bfb5f64-trs6t\" (UID: \"30eeaa52-243c-4b47-8d1f-447e61ecd9f0\") " pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:33.899888 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.899816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 20:25:33.909941 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.909866    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65cbbfc584-hgdtq"]
Jul 06 20:25:33.958623 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958567    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-installation-pull-secrets\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958632    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-certificates\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958672    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-trusted-ca\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-ca-trust-extracted\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdl8\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-kube-api-access-jrdl8\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-bound-sa-token\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-tls\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:33.959033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:33.958848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-image-registry-private-configuration\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.008076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.008045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:34.019180 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.019147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:34.060133 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-installation-pull-secrets\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060299 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-certificates\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060299 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060206    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-trusted-ca\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060299 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-ca-trust-extracted\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060299 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060276    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdl8\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-kube-api-access-jrdl8\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-bound-sa-token\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-tls\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.060518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.060414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-image-registry-private-configuration\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.061137 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.061106    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-ca-trust-extracted\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.061681 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.061656    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-certificates\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.062264 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.062218    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-trusted-ca\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.064788 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.064760    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-installation-pull-secrets\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.064906 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.064854    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-registry-tls\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.065374 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.065290    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-image-registry-private-configuration\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.076945 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.076884    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-bound-sa-token\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.078305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.078248    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdl8\" (UniqueName: \"kubernetes.io/projected/a72aa4ae-5eff-4e76-a8f0-f6d3043816eb-kube-api-access-jrdl8\") pod \"image-registry-65cbbfc584-hgdtq\" (UID: \"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb\") " pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.207345 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.207309    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.218400 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.218368    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-trs6t"]
Jul 06 20:25:34.219566 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:34.219507    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30eeaa52_243c_4b47_8d1f_447e61ecd9f0.slice/crio-90329621e1097a2c44c12f77065832f567c62654b26b561d08ca2a248ba49b20 WatchSource:0}: Error finding container 90329621e1097a2c44c12f77065832f567c62654b26b561d08ca2a248ba49b20: Status 404 returned error can't find the container with id 90329621e1097a2c44c12f77065832f567c62654b26b561d08ca2a248ba49b20
Jul 06 20:25:34.222459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.222434    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"]
Jul 06 20:25:34.226160 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:34.226130    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd8f243_603e_42f8_a5c8_00af5216009c.slice/crio-89792be4b6e3cbdfc40b5fff4003737982c41e32b6721021c623ad25e0e19500 WatchSource:0}: Error finding container 89792be4b6e3cbdfc40b5fff4003737982c41e32b6721021c623ad25e0e19500: Status 404 returned error can't find the container with id 89792be4b6e3cbdfc40b5fff4003737982c41e32b6721021c623ad25e0e19500
Jul 06 20:25:34.379627 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.379518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65cbbfc584-hgdtq"]
Jul 06 20:25:34.383875 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:34.383840    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72aa4ae_5eff_4e76_a8f0_f6d3043816eb.slice/crio-285edf9b4c468ffaabab2db01012cb6a4ca81c8076a91a65d0cdd7c9d9b5546a WatchSource:0}: Error finding container 285edf9b4c468ffaabab2db01012cb6a4ca81c8076a91a65d0cdd7c9d9b5546a: Status 404 returned error can't find the container with id 285edf9b4c468ffaabab2db01012cb6a4ca81c8076a91a65d0cdd7c9d9b5546a
Jul 06 20:25:34.606674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.606642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq" event={"ID":"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb","Type":"ContainerStarted","Data":"ba15a107654680a26de3487023ad45e1aaa1ebce69eb4eb1db12a8d5cac8fef1"}
Jul 06 20:25:34.606864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.606696    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq" event={"ID":"a72aa4ae-5eff-4e76-a8f0-f6d3043816eb","Type":"ContainerStarted","Data":"285edf9b4c468ffaabab2db01012cb6a4ca81c8076a91a65d0cdd7c9d9b5546a"}
Jul 06 20:25:34.606864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.606743    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:34.608042 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.608013    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl" event={"ID":"7dd8f243-603e-42f8-a5c8-00af5216009c","Type":"ContainerStarted","Data":"89792be4b6e3cbdfc40b5fff4003737982c41e32b6721021c623ad25e0e19500"}
Jul 06 20:25:34.609228 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.609204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-trs6t" event={"ID":"30eeaa52-243c-4b47-8d1f-447e61ecd9f0","Type":"ContainerStarted","Data":"90329621e1097a2c44c12f77065832f567c62654b26b561d08ca2a248ba49b20"}
Jul 06 20:25:34.658525 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.658437    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq" podStartSLOduration=1.6584198510000001 podStartE2EDuration="1.658419851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:34.653751325 +0000 UTC m=+97.089404512" watchObservedRunningTime="2026-07-06 20:25:34.658419851 +0000 UTC m=+97.094073025"
Jul 06 20:25:34.988375 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.988271    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:25:34.999835 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:34.999806    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.004794 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.003897    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2hph\""
Jul 06 20:25:35.005475 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.005449    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 20:25:35.005759 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.005742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 20:25:35.006119 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.006099    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 20:25:35.006316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.006301    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 20:25:35.006434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.006374    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 20:25:35.009826 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.009800    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:25:35.071303 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071270    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.071303 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.071555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.071555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.071555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.071555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.071538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfq8\" (UniqueName: \"kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172192 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172371 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172371 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfq8\" (UniqueName: \"kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172371 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172371 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.172577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.172402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.173092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.173067    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.173214 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.173065    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.173214 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.173069    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.175181 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.175130    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.175181 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.175136    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.181701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.181675    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfq8\" (UniqueName: \"kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8\") pod \"console-7db696fdfb-xdf77\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") " pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:35.315424 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:35.315314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:36.785762 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:36.785725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:36.788348 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:36.788314    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b28010-18c1-4f51-80d8-f0c5383f791c-metrics-tls\") pod \"dns-default-776j4\" (UID: \"a6b28010-18c1-4f51-80d8-f0c5383f791c\") " pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:37.067995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.067913    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mqhkz\""
Jul 06 20:25:37.076039 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.075982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:37.078715 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.078684    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:25:37.247388 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:37.247338    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41e8aad_200c_432e_aa40_bd428addbb72.slice/crio-ad5d39b6aef5c1766f6a1348c23c48cc4404f2952028f1c9c3d4c3267b84feb1 WatchSource:0}: Error finding container ad5d39b6aef5c1766f6a1348c23c48cc4404f2952028f1c9c3d4c3267b84feb1: Status 404 returned error can't find the container with id ad5d39b6aef5c1766f6a1348c23c48cc4404f2952028f1c9c3d4c3267b84feb1
Jul 06 20:25:37.389256 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.389222    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-776j4"]
Jul 06 20:25:37.393069 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:37.393020    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b28010_18c1_4f51_80d8_f0c5383f791c.slice/crio-05ef594c1ee4009e58aa2c9c584ffa687a313c4d66686fe3b5f27b077e09d556 WatchSource:0}: Error finding container 05ef594c1ee4009e58aa2c9c584ffa687a313c4d66686fe3b5f27b077e09d556: Status 404 returned error can't find the container with id 05ef594c1ee4009e58aa2c9c584ffa687a313c4d66686fe3b5f27b077e09d556
Jul 06 20:25:37.621290 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.621257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl" event={"ID":"7dd8f243-603e-42f8-a5c8-00af5216009c","Type":"ContainerStarted","Data":"dc8573af26832638fe39126d98f0421343df6617248048e33108cf93d98a3eb8"}
Jul 06 20:25:37.621520 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.621476    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:37.622724 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.622701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776j4" event={"ID":"a6b28010-18c1-4f51-80d8-f0c5383f791c","Type":"ContainerStarted","Data":"05ef594c1ee4009e58aa2c9c584ffa687a313c4d66686fe3b5f27b077e09d556"}
Jul 06 20:25:37.624029 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.624003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db696fdfb-xdf77" event={"ID":"e41e8aad-200c-432e-aa40-bd428addbb72","Type":"ContainerStarted","Data":"ad5d39b6aef5c1766f6a1348c23c48cc4404f2952028f1c9c3d4c3267b84feb1"}
Jul 06 20:25:37.625349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.625330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pc9qm" event={"ID":"0005742e-a52a-4a43-8919-32878acc6367","Type":"ContainerStarted","Data":"03b0fe016e91edbdc387359b1b777b0363ff6c51790654e9eee3316da2a064d2"}
Jul 06 20:25:37.626542 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.626523    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl"
Jul 06 20:25:37.638129 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:37.638087    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-28lsl" podStartSLOduration=1.571371467 podStartE2EDuration="4.638071733s" totalImagesPullingTime="3.066700266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:37.637604649 +0000 UTC m=+100.073257827" watchObservedRunningTime="2026-07-06 20:25:37.638071733 +0000 UTC m=+100.073724905"
Jul 06 20:25:38.300178 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:38.300087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:38.303418 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:38.303338    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a96b41f-e020-4fa2-b6b8-a07ae09d2124-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-7vwcx\" (UID: \"9a96b41f-e020-4fa2-b6b8-a07ae09d2124\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:38.529340 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:38.529300    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"
Jul 06 20:25:38.633179 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:38.633134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pc9qm" event={"ID":"0005742e-a52a-4a43-8919-32878acc6367","Type":"ContainerStarted","Data":"753c070ed0f61fd2ee1d0fe93c4290a17ce0907b2c53147b9f18617be2f59db7"}
Jul 06 20:25:38.719294 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:38.718004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx"]
Jul 06 20:25:38.723370 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:38.723315    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a96b41f_e020_4fa2_b6b8_a07ae09d2124.slice/crio-93f3c52da95b36dc1c179a6621d1590f813413914bf7e7b5664627f8e505365d WatchSource:0}: Error finding container 93f3c52da95b36dc1c179a6621d1590f813413914bf7e7b5664627f8e505365d: Status 404 returned error can't find the container with id 93f3c52da95b36dc1c179a6621d1590f813413914bf7e7b5664627f8e505365d
Jul 06 20:25:39.641437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:39.641370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx" event={"ID":"9a96b41f-e020-4fa2-b6b8-a07ae09d2124","Type":"ContainerStarted","Data":"93f3c52da95b36dc1c179a6621d1590f813413914bf7e7b5664627f8e505365d"}
Jul 06 20:25:40.522830 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:40.522799    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4vxb4"
Jul 06 20:25:41.148240 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.147846    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:25:41.235373 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.235317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:25:41.235561 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.235444    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.243631 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.243579    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 20:25:41.325444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325662 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325507    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325662 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5crwk\" (UniqueName: \"kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325662 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325703    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.325831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.325774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.426856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.426856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.426856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426850    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5crwk\" (UniqueName: \"kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.426997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427767 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.427735    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.427768    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.427735    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.427899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.427820    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.429292 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.429264    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.429474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.429454    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.435410 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.435387    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5crwk\" (UniqueName: \"kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk\") pod \"console-65fb57b9bf-qc6c5\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") " pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:41.548085 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:41.548050    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:44.124498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.124302    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:25:44.663503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.663467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pc9qm" event={"ID":"0005742e-a52a-4a43-8919-32878acc6367","Type":"ContainerStarted","Data":"0e73c2bdb26a6f23d25977c2c8894475dd7514ac2bc4ba1a6ace249562c3f7e6"}
Jul 06 20:25:44.664916 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.664891    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx" event={"ID":"9a96b41f-e020-4fa2-b6b8-a07ae09d2124","Type":"ContainerStarted","Data":"6fcf4b744717b1745ac565c83a59927c98923ccabae96e687c14fe560ccad5ad"}
Jul 06 20:25:44.666317 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.666293    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fb57b9bf-qc6c5" event={"ID":"f822c7d4-bc43-4f2a-90e2-76ba57f3e103","Type":"ContainerStarted","Data":"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"}
Jul 06 20:25:44.666442 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.666334    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fb57b9bf-qc6c5" event={"ID":"f822c7d4-bc43-4f2a-90e2-76ba57f3e103","Type":"ContainerStarted","Data":"baaf7882dc6065995d2851e3c6bb0945fb0a7e26bcaadca38d804e7d38a03312"}
Jul 06 20:25:44.667827 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.667806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776j4" event={"ID":"a6b28010-18c1-4f51-80d8-f0c5383f791c","Type":"ContainerStarted","Data":"96be766efb40db40a8086de2d8b4128d68c9c8a4501fe568618fd015de42b941"}
Jul 06 20:25:44.667940 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.667848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776j4" event={"ID":"a6b28010-18c1-4f51-80d8-f0c5383f791c","Type":"ContainerStarted","Data":"8246cc6dd0b10199b2f1214c127a5bff77bce10788a929450704d82240c37c9a"}
Jul 06 20:25:44.667940 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.667877    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:44.669220 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.669192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db696fdfb-xdf77" event={"ID":"e41e8aad-200c-432e-aa40-bd428addbb72","Type":"ContainerStarted","Data":"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"}
Jul 06 20:25:44.685475 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.685424    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pc9qm" podStartSLOduration=33.861936932 podStartE2EDuration="44.685408811s" totalImagesPullingTime="10.823471879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:25:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:44.683075346 +0000 UTC m=+107.118728524" watchObservedRunningTime="2026-07-06 20:25:44.685408811 +0000 UTC m=+107.121061987"
Jul 06 20:25:44.706289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.706143    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-776j4" podStartSLOduration=66.148897811 podStartE2EDuration="1m12.706118603s" totalImagesPullingTime="6.557220792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:44.703159273 +0000 UTC m=+107.138812449" watchObservedRunningTime="2026-07-06 20:25:44.706118603 +0000 UTC m=+107.141771782"
Jul 06 20:25:44.727777 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.727715    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-7vwcx" podStartSLOduration=33.500939372 podStartE2EDuration="38.727694881s" totalImagesPullingTime="5.226755509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:44.727325336 +0000 UTC m=+107.162978515" watchObservedRunningTime="2026-07-06 20:25:44.727694881 +0000 UTC m=+107.163348058"
Jul 06 20:25:44.749714 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.749653    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db696fdfb-xdf77" podStartSLOduration=4.04742417 podStartE2EDuration="10.749636674s" totalImagesPullingTime="6.702212504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:44.747981245 +0000 UTC m=+107.183634422" watchObservedRunningTime="2026-07-06 20:25:44.749636674 +0000 UTC m=+107.185289849"
Jul 06 20:25:44.766618 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:44.766566    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65fb57b9bf-qc6c5" podStartSLOduration=3.766548907 podStartE2EDuration="3.766548907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:44.766517444 +0000 UTC m=+107.202170621" watchObservedRunningTime="2026-07-06 20:25:44.766548907 +0000 UTC m=+107.202202083"
Jul 06 20:25:45.106992 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.106909    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"]
Jul 06 20:25:45.110084 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.110065    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.113680 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.113647    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gc9x6\""
Jul 06 20:25:45.113833 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.113710    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 20:25:45.113893 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.113870    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 20:25:45.113931 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.113900    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 20:25:45.123799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.123771    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"]
Jul 06 20:25:45.129039 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.129009    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r44kj"]
Jul 06 20:25:45.131584 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.131558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.134407 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.134388    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 20:25:45.134703 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.134688    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 20:25:45.134758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.134709    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 20:25:45.135234 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.135216    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h2cwn\""
Jul 06 20:25:45.163229 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.163229 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-sys\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163280    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9925d557-aaad-4801-b02e-84d07116e8b4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.163496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163386    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.163496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-metrics-client-ca\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhg9z\" (UniqueName: \"kubernetes.io/projected/9925d557-aaad-4801-b02e-84d07116e8b4-kube-api-access-zhg9z\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-textfile\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-wtmp\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9dx\" (UniqueName: \"kubernetes.io/projected/b92bd071-ba1d-46c9-9abb-3a63bff0735d-kube-api-access-gh9dx\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-root\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.163758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.163683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-accelerators-collector-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.264626 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.264626 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9925d557-aaad-4801-b02e-84d07116e8b4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264658    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264708    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-metrics-client-ca\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhg9z\" (UniqueName: \"kubernetes.io/projected/9925d557-aaad-4801-b02e-84d07116e8b4-kube-api-access-zhg9z\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:45.264759    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:45.264848    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls podName:b92bd071-ba1d-46c9-9abb-3a63bff0735d nodeName:}" failed. No retries permitted until 2026-07-06 20:25:45.764827471 +0000 UTC m=+108.200480629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls") pod "node-exporter-r44kj" (UID: "b92bd071-ba1d-46c9-9abb-3a63bff0735d") : secret "node-exporter-tls" not found
Jul 06 20:25:45.264875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-textfile\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-wtmp\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9dx\" (UniqueName: \"kubernetes.io/projected/b92bd071-ba1d-46c9-9abb-3a63bff0735d-kube-api-access-gh9dx\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-root\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.264989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-accelerators-collector-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-sys\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265152    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-sys\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265169    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-textfile\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-root\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265483    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-wtmp\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:45.265502    2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265572    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-metrics-client-ca\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:25:45.265581    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls podName:9925d557-aaad-4801-b02e-84d07116e8b4 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:45.765563019 +0000 UTC m=+108.201216178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-9stn2" (UID: "9925d557-aaad-4801-b02e-84d07116e8b4") : secret "openshift-state-metrics-tls" not found
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265506    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9925d557-aaad-4801-b02e-84d07116e8b4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.265943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.265686    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-accelerators-collector-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.267194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.267172    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.267327 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.267309    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.277020 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.276990    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhg9z\" (UniqueName: \"kubernetes.io/projected/9925d557-aaad-4801-b02e-84d07116e8b4-kube-api-access-zhg9z\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.277487 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.277465    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9dx\" (UniqueName: \"kubernetes.io/projected/b92bd071-ba1d-46c9-9abb-3a63bff0735d-kube-api-access-gh9dx\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.316295 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.316259    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:45.316494 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.316343    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:25:45.317865 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.317831    2571 patch_prober.go:28] interesting pod/console-7db696fdfb-xdf77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body=
Jul 06 20:25:45.317986 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.317891    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7db696fdfb-xdf77" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused"
Jul 06 20:25:45.769853 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.769812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.770764 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.770557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:45.772685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.772658    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b92bd071-ba1d-46c9-9abb-3a63bff0735d-node-exporter-tls\") pod \"node-exporter-r44kj\" (UID: \"b92bd071-ba1d-46c9-9abb-3a63bff0735d\") " pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:45.773102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:45.773075    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9925d557-aaad-4801-b02e-84d07116e8b4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9stn2\" (UID: \"9925d557-aaad-4801-b02e-84d07116e8b4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:46.019665 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.019629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"
Jul 06 20:25:46.042603 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.042567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r44kj"
Jul 06 20:25:46.056425 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:46.056391    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92bd071_ba1d_46c9_9abb_3a63bff0735d.slice/crio-b68639abb68e11ae4128e989189eec282ff4d88b6e1a47c5d0918999b15b8204 WatchSource:0}: Error finding container b68639abb68e11ae4128e989189eec282ff4d88b6e1a47c5d0918999b15b8204: Status 404 returned error can't find the container with id b68639abb68e11ae4128e989189eec282ff4d88b6e1a47c5d0918999b15b8204
Jul 06 20:25:46.176057 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.176031    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2"]
Jul 06 20:25:46.176781 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:46.176754    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9925d557_aaad_4801_b02e_84d07116e8b4.slice/crio-cb367be87d46dcad39e9dbc0f4a3f5a0c40734a67cb4225c6859aec27294cf90 WatchSource:0}: Error finding container cb367be87d46dcad39e9dbc0f4a3f5a0c40734a67cb4225c6859aec27294cf90: Status 404 returned error can't find the container with id cb367be87d46dcad39e9dbc0f4a3f5a0c40734a67cb4225c6859aec27294cf90
Jul 06 20:25:46.682453 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.682286    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2" event={"ID":"9925d557-aaad-4801-b02e-84d07116e8b4","Type":"ContainerStarted","Data":"2a108c56452a3e3b631d8dacea46ba4bba2f7ad88126ec86a927eb26295f17d0"}
Jul 06 20:25:46.682453 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.682378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2" event={"ID":"9925d557-aaad-4801-b02e-84d07116e8b4","Type":"ContainerStarted","Data":"44f54dfb7ea99e96162d83c67413996af971762190e29b1ae0c6abc4d3f78259"}
Jul 06 20:25:46.682453 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.682414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2" event={"ID":"9925d557-aaad-4801-b02e-84d07116e8b4","Type":"ContainerStarted","Data":"cb367be87d46dcad39e9dbc0f4a3f5a0c40734a67cb4225c6859aec27294cf90"}
Jul 06 20:25:46.684394 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:46.684342    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r44kj" event={"ID":"b92bd071-ba1d-46c9-9abb-3a63bff0735d","Type":"ContainerStarted","Data":"b68639abb68e11ae4128e989189eec282ff4d88b6e1a47c5d0918999b15b8204"}
Jul 06 20:25:47.238160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.238120    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"]
Jul 06 20:25:47.245231 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.245199    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.259120 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.259085    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 20:25:47.259619 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.259595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-64l9eaoqk01tn\""
Jul 06 20:25:47.259738 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.259595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 20:25:47.260199 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.260182    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 20:25:47.260274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.260197    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wfth4\""
Jul 06 20:25:47.260274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.260182    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 20:25:47.260274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.260214    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 20:25:47.269785 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.269755    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"]
Jul 06 20:25:47.285141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285098    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjgq2\" (UniqueName: \"kubernetes.io/projected/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-kube-api-access-fjgq2\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285267    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-metrics-client-ca\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-grpc-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285317    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.285628 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.285502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386248 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjgq2\" (UniqueName: \"kubernetes.io/projected/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-kube-api-access-fjgq2\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-metrics-client-ca\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-grpc-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386474 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.386772 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.386509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.387216 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.387150    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-metrics-client-ca\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.389912 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.389860    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.389912 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.389868    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.390096 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.390044    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-grpc-tls\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.390952 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.390909    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.392175 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.392105    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.392875 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.392851    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.395348 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.395296    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjgq2\" (UniqueName: \"kubernetes.io/projected/1bca3da4-4f8c-488f-8ff3-1da04e5d2e83-kube-api-access-fjgq2\") pod \"thanos-querier-579dc8fb8-l7bq6\" (UID: \"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83\") " pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.556792 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.556715    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:47.692726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.692685    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2" event={"ID":"9925d557-aaad-4801-b02e-84d07116e8b4","Type":"ContainerStarted","Data":"d0be666737f55ee8e17e61fee014ec5c23480a615318e29cc94bd0cf3b71779b"}
Jul 06 20:25:47.695573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.695530    2571 generic.go:356] "Generic (PLEG): container finished" podID="b92bd071-ba1d-46c9-9abb-3a63bff0735d" containerID="5b76bef08d3902c98906b177776bd6b810e9c7a499d8816763b1a6f372aecf44" exitCode=0
Jul 06 20:25:47.695737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.695603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r44kj" event={"ID":"b92bd071-ba1d-46c9-9abb-3a63bff0735d","Type":"ContainerDied","Data":"5b76bef08d3902c98906b177776bd6b810e9c7a499d8816763b1a6f372aecf44"}
Jul 06 20:25:47.713726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.713506    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9stn2" podStartSLOduration=1.456654098 podStartE2EDuration="2.713482452s" totalImagesPullingTime="1.256828354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:47.711868826 +0000 UTC m=+110.147522022" watchObservedRunningTime="2026-07-06 20:25:47.713482452 +0000 UTC m=+110.149135632"
Jul 06 20:25:47.722945 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:47.722916    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"]
Jul 06 20:25:47.730555 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:25:47.730524    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bca3da4_4f8c_488f_8ff3_1da04e5d2e83.slice/crio-f7a60612b5628398c31d24e32d014ffa3c51df57ee242b1edf90ddb6ecb25d17 WatchSource:0}: Error finding container f7a60612b5628398c31d24e32d014ffa3c51df57ee242b1edf90ddb6ecb25d17: Status 404 returned error can't find the container with id f7a60612b5628398c31d24e32d014ffa3c51df57ee242b1edf90ddb6ecb25d17
Jul 06 20:25:48.708580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:48.708532    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r44kj" event={"ID":"b92bd071-ba1d-46c9-9abb-3a63bff0735d","Type":"ContainerStarted","Data":"813882ee13bb6af4dc3d957b6b92f412d8965bfe69c6bfce07b8383741e5e275"}
Jul 06 20:25:48.709025 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:48.708641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r44kj" event={"ID":"b92bd071-ba1d-46c9-9abb-3a63bff0735d","Type":"ContainerStarted","Data":"0dbb6ec2d07f25ffd48b88bfba0fecf80bb66b03e1f3fc2b8e261d8c26217190"}
Jul 06 20:25:48.711263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:48.711232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"f7a60612b5628398c31d24e32d014ffa3c51df57ee242b1edf90ddb6ecb25d17"}
Jul 06 20:25:48.730175 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:48.730109    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r44kj" podStartSLOduration=2.531103067 podStartE2EDuration="3.730085856s" totalImagesPullingTime="1.116189671s" totalInitContainerRuntime="82.793118ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:48.727954102 +0000 UTC m=+111.163607280" watchObservedRunningTime="2026-07-06 20:25:48.730085856 +0000 UTC m=+111.165739014"
Jul 06 20:25:49.913516 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:49.913474    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:25:50.722430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:50.722391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"fdf6411916183a9351c23de9dad5a7174010dacf49f599afb9f4f88f91de8271"}
Jul 06 20:25:50.722599 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:50.722485    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"035329f71b3d36b5228f9474a1fc5453cac6922944ed2fcb64187d4b5eac5989"}
Jul 06 20:25:50.722599 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:50.722530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"da9cb94f1dfab7875c2459b72a0511cdc099ea4de626707be027f99c07d8779b"}
Jul 06 20:25:51.548825 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:51.548787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:51.549280 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:51.548860    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:25:51.550451 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:51.550420    2571 patch_prober.go:28] interesting pod/console-65fb57b9bf-qc6c5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body=
Jul 06 20:25:51.550572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:51.550479    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fb57b9bf-qc6c5" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused"
Jul 06 20:25:54.212592 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:54.212554    2571 patch_prober.go:28] interesting pod/image-registry-65cbbfc584-hgdtq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 20:25:54.212967 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:54.212627    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq" podUID="a72aa4ae-5eff-4e76-a8f0-f6d3043816eb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:25:54.675672 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:54.675633    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-776j4"
Jul 06 20:25:55.619037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:55.619008    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65cbbfc584-hgdtq"
Jul 06 20:25:58.759768 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.759726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-trs6t" event={"ID":"30eeaa52-243c-4b47-8d1f-447e61ecd9f0","Type":"ContainerStarted","Data":"6902cd60db383798e6744ddd3669c745529ec275ab61ede82ff25b441edb03b5"}
Jul 06 20:25:58.760206 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.760047    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:58.763529 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.763493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"70c28c0a5552b2cc562a642a0c8693085d146075e7a48e651acdaa7fdb9e649e"}
Jul 06 20:25:58.763685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.763578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"03904325449d6a0c6c505c2ff22166776ddda4a0d50e43b31f60beb62bf7bb57"}
Jul 06 20:25:58.763685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.763624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" event={"ID":"1bca3da4-4f8c-488f-8ff3-1da04e5d2e83","Type":"ContainerStarted","Data":"8414a1e839259e828396627e6b2bdb5ad5c77fdd30b45accceb3577ba432d01c"}
Jul 06 20:25:58.763685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.763673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:58.768766 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.768737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-trs6t"
Jul 06 20:25:58.770002 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.769978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6"
Jul 06 20:25:58.780056 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.780000    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-trs6t" podStartSLOduration=1.503829318 podStartE2EDuration="25.779984284s" totalImagesPullingTime="24.276154966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:58.778863405 +0000 UTC m=+121.214516583" watchObservedRunningTime="2026-07-06 20:25:58.779984284 +0000 UTC m=+121.215637461"
Jul 06 20:25:58.834943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:25:58.834886    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-579dc8fb8-l7bq6" podStartSLOduration=1.307587179 podStartE2EDuration="11.834862302s" totalImagesPullingTime="10.527275123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:58.831775827 +0000 UTC m=+121.267429034" watchObservedRunningTime="2026-07-06 20:25:58.834862302 +0000 UTC m=+121.270515480"
Jul 06 20:26:00.542534 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:00.542499    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:26:07.890812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:07.890765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:26:07.893165 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:07.893134    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5c4cadc-ea3b-4d5f-92e8-549cf93d3119-metrics-certs\") pod \"network-metrics-daemon-bd72t\" (UID: \"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119\") " pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:26:08.000482 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:08.000448    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z7zd8\""
Jul 06 20:26:08.008723 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:08.008700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bd72t"
Jul 06 20:26:08.217802 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:08.217751    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bd72t"]
Jul 06 20:26:08.220471 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:26:08.220430    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c4cadc_ea3b_4d5f_92e8_549cf93d3119.slice/crio-dacd9705bba85540d0185189ba3d6ad13fd2f9e8876764809b60a133d11f4aeb WatchSource:0}: Error finding container dacd9705bba85540d0185189ba3d6ad13fd2f9e8876764809b60a133d11f4aeb: Status 404 returned error can't find the container with id dacd9705bba85540d0185189ba3d6ad13fd2f9e8876764809b60a133d11f4aeb
Jul 06 20:26:08.809436 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:08.809394    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd72t" event={"ID":"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119","Type":"ContainerStarted","Data":"dacd9705bba85540d0185189ba3d6ad13fd2f9e8876764809b60a133d11f4aeb"}
Jul 06 20:26:09.815004 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:09.814961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd72t" event={"ID":"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119","Type":"ContainerStarted","Data":"8f778210b83292c213b951b4cb81fa254b585bf78837c09072646fb7a9b9eef3"}
Jul 06 20:26:10.820814 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:10.820777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bd72t" event={"ID":"b5c4cadc-ea3b-4d5f-92e8-549cf93d3119","Type":"ContainerStarted","Data":"9a99aaea90846c86253dd2857efd6b36e38c54a8e7e828d3d7e6dddf7d9baa71"}
Jul 06 20:26:10.845064 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:10.845003    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bd72t" podStartSLOduration=131.418181916 podStartE2EDuration="2m12.844985486s" totalImagesPullingTime="1.42680357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:10.842548814 +0000 UTC m=+133.278201990" watchObservedRunningTime="2026-07-06 20:26:10.844985486 +0000 UTC m=+133.280638662"
Jul 06 20:26:14.938119 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:14.938050    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7db696fdfb-xdf77" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" containerName="console" containerID="cri-o://065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c" gracePeriod=15
Jul 06 20:26:15.238739 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.238699    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:26:15.357917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.357883    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358121 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.357939    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358121 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.357967    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358121 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.357989    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358121 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.358024    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358121 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.358047    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtfq8\" (UniqueName: \"kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8\") pod \"e41e8aad-200c-432e-aa40-bd428addbb72\" (UID: \"e41e8aad-200c-432e-aa40-bd428addbb72\") "
Jul 06 20:26:15.358444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.358407    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config" (OuterVolumeSpecName: "console-config") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:15.358585 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.358449    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca" (OuterVolumeSpecName: "service-ca") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:15.358585 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.358454    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:15.360302 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.360277    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:15.360430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.360298    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:15.360430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.360406    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8" (OuterVolumeSpecName: "kube-api-access-dtfq8") pod "e41e8aad-200c-432e-aa40-bd428addbb72" (UID: "e41e8aad-200c-432e-aa40-bd428addbb72"). InnerVolumeSpecName "kube-api-access-dtfq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458843    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458871    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e41e8aad-200c-432e-aa40-bd428addbb72-console-oauth-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458883    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-service-ca\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458891    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-oauth-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458901    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e41e8aad-200c-432e-aa40-bd428addbb72-console-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.458929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.458909    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtfq8\" (UniqueName: \"kubernetes.io/projected/e41e8aad-200c-432e-aa40-bd428addbb72-kube-api-access-dtfq8\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:15.858890 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.858801    2571 generic.go:356] "Generic (PLEG): container finished" podID="e41e8aad-200c-432e-aa40-bd428addbb72" containerID="065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c" exitCode=0
Jul 06 20:26:15.858890 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.858849    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db696fdfb-xdf77"
Jul 06 20:26:15.859125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.858884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db696fdfb-xdf77" event={"ID":"e41e8aad-200c-432e-aa40-bd428addbb72","Type":"ContainerDied","Data":"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"}
Jul 06 20:26:15.859125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.858939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db696fdfb-xdf77" event={"ID":"e41e8aad-200c-432e-aa40-bd428addbb72","Type":"ContainerDied","Data":"ad5d39b6aef5c1766f6a1348c23c48cc4404f2952028f1c9c3d4c3267b84feb1"}
Jul 06 20:26:15.859125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.858969    2571 scope.go:117] "RemoveContainer" containerID="065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"
Jul 06 20:26:15.860476 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.860449    2571 generic.go:356] "Generic (PLEG): container finished" podID="2e38a63b-8a3c-48be-80f6-de0d3f154f96" containerID="ed82e5429a345d0cf17c9706d625b9f0c5f9643a3f8b32563f811c0bcbcabdcc" exitCode=0
Jul 06 20:26:15.860580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.860494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg" event={"ID":"2e38a63b-8a3c-48be-80f6-de0d3f154f96","Type":"ContainerDied","Data":"ed82e5429a345d0cf17c9706d625b9f0c5f9643a3f8b32563f811c0bcbcabdcc"}
Jul 06 20:26:15.860797 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.860783    2571 scope.go:117] "RemoveContainer" containerID="ed82e5429a345d0cf17c9706d625b9f0c5f9643a3f8b32563f811c0bcbcabdcc"
Jul 06 20:26:15.868124 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.868107    2571 scope.go:117] "RemoveContainer" containerID="065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"
Jul 06 20:26:15.868452 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:26:15.868425    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c\": container with ID starting with 065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c not found: ID does not exist" containerID="065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"
Jul 06 20:26:15.868510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.868467    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c"} err="failed to get container status \"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c\": rpc error: code = NotFound desc = could not find container \"065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c\": container with ID starting with 065866bd34e3e12609fe7fd53b9912cf36e1a22550af6e6a61dbf615daa7ae2c not found: ID does not exist"
Jul 06 20:26:15.896130 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.896090    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:26:15.902755 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:15.902724    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db696fdfb-xdf77"]
Jul 06 20:26:16.176079 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:16.176047    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" path="/var/lib/kubelet/pods/e41e8aad-200c-432e-aa40-bd428addbb72/volumes"
Jul 06 20:26:16.866207 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:16.866176    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-97vdg" event={"ID":"2e38a63b-8a3c-48be-80f6-de0d3f154f96","Type":"ContainerStarted","Data":"cc237282ca52bc2c22367979b62007b78d991b0bfa3a7c81f91100f767f5430d"}
Jul 06 20:26:22.893929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:22.893892    2571 generic.go:356] "Generic (PLEG): container finished" podID="93b7f44d-300d-4052-9369-dd63cfc2c9e8" containerID="7976faf5a6a97efaaf688cd098d10729374e15e51925667c38bb031a11d90aa1" exitCode=0
Jul 06 20:26:22.894439 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:22.893958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm" event={"ID":"93b7f44d-300d-4052-9369-dd63cfc2c9e8","Type":"ContainerDied","Data":"7976faf5a6a97efaaf688cd098d10729374e15e51925667c38bb031a11d90aa1"}
Jul 06 20:26:22.894439 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:22.894292    2571 scope.go:117] "RemoveContainer" containerID="7976faf5a6a97efaaf688cd098d10729374e15e51925667c38bb031a11d90aa1"
Jul 06 20:26:23.900067 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:23.900029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-z94dm" event={"ID":"93b7f44d-300d-4052-9369-dd63cfc2c9e8","Type":"ContainerStarted","Data":"5b9928b13c66f3d51f8411e99099767b9cf074a7da2827ed57679bc8bb0c04fb"}
Jul 06 20:26:25.567513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.567473    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65fb57b9bf-qc6c5" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerName="console" containerID="cri-o://e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5" gracePeriod=15
Jul 06 20:26:25.847482 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.847448    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:26:25.910440 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.910405    2571 generic.go:356] "Generic (PLEG): container finished" podID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerID="e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5" exitCode=0
Jul 06 20:26:25.910608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.910464    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fb57b9bf-qc6c5"
Jul 06 20:26:25.910608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.910496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fb57b9bf-qc6c5" event={"ID":"f822c7d4-bc43-4f2a-90e2-76ba57f3e103","Type":"ContainerDied","Data":"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"}
Jul 06 20:26:25.910608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.910556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fb57b9bf-qc6c5" event={"ID":"f822c7d4-bc43-4f2a-90e2-76ba57f3e103","Type":"ContainerDied","Data":"baaf7882dc6065995d2851e3c6bb0945fb0a7e26bcaadca38d804e7d38a03312"}
Jul 06 20:26:25.910608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.910580    2571 scope.go:117] "RemoveContainer" containerID="e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"
Jul 06 20:26:25.918573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.918521    2571 scope.go:117] "RemoveContainer" containerID="e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"
Jul 06 20:26:25.918821 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:26:25.918801    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5\": container with ID starting with e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5 not found: ID does not exist" containerID="e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"
Jul 06 20:26:25.918883 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.918838    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5"} err="failed to get container status \"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5\": rpc error: code = NotFound desc = could not find container \"e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5\": container with ID starting with e99dd0ae1540038df0a303588a4db00766971205a77d64ff84cae448decc06d5 not found: ID does not exist"
Jul 06 20:26:25.939239 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939239 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939245    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939280    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939469    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939531    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939576    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5crwk\" (UniqueName: \"kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939712 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939609    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle\") pod \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\" (UID: \"f822c7d4-bc43-4f2a-90e2-76ba57f3e103\") "
Jul 06 20:26:25.939764 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939723    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:25.939864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939840    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config" (OuterVolumeSpecName: "console-config") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:25.939924 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939889    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-oauth-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:25.939980 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.939936    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca" (OuterVolumeSpecName: "service-ca") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:25.940073 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.940050    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:26:25.941498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.941474    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:25.941604 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.941527    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:25.941643 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:25.941611    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk" (OuterVolumeSpecName: "kube-api-access-5crwk") pod "f822c7d4-bc43-4f2a-90e2-76ba57f3e103" (UID: "f822c7d4-bc43-4f2a-90e2-76ba57f3e103"). InnerVolumeSpecName "kube-api-access-5crwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:26.040263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040226    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-trusted-ca-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.040263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040253    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-oauth-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.040263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040262    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.040263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040271    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-console-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.040548 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040281    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-service-ca\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.040548 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.040289    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5crwk\" (UniqueName: \"kubernetes.io/projected/f822c7d4-bc43-4f2a-90e2-76ba57f3e103-kube-api-access-5crwk\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:26:26.227180 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.227147    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:26:26.232316 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:26.232292    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65fb57b9bf-qc6c5"]
Jul 06 20:26:28.176417 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:26:28.176384    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" path="/var/lib/kubelet/pods/f822c7d4-bc43-4f2a-90e2-76ba57f3e103/volumes"
Jul 06 20:27:09.508947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.508910    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-965f88b65-tb5ns"]
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509199    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerName="console"
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509211    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerName="console"
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509231    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" containerName="console"
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509237    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" containerName="console"
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509286    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41e8aad-200c-432e-aa40-bd428addbb72" containerName="console"
Jul 06 20:27:09.509459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.509295    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f822c7d4-bc43-4f2a-90e2-76ba57f3e103" containerName="console"
Jul 06 20:27:09.512123 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.512104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.514581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514548    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 20:27:09.514581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514572    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 20:27:09.514829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514588    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 20:27:09.514829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514735    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7zlcd\""
Jul 06 20:27:09.514930 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514875    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 20:27:09.514930 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.514879    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 20:27:09.523496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.522306    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 20:27:09.529025 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.528996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-965f88b65-tb5ns"]
Jul 06 20:27:09.567124 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567093    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-serving-certs-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567124 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-metrics-client-ca\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrsg5\" (UniqueName: \"kubernetes.io/projected/d8148107-369a-4b22-bed8-36d61cfe2434-kube-api-access-xrsg5\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-federate-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.567557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.567434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-trusted-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.667888 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.667852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-federate-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.667888 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.667895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-trusted-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.667929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-serving-certs-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-metrics-client-ca\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668387 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668387 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrsg5\" (UniqueName: \"kubernetes.io/projected/d8148107-369a-4b22-bed8-36d61cfe2434-kube-api-access-xrsg5\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668690 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668665    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-serving-certs-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668866 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668843    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-trusted-ca-bundle\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.668972 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.668855    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8148107-369a-4b22-bed8-36d61cfe2434-metrics-client-ca\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.670613 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.670586    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-federate-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.670778 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.670666    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-telemeter-client-tls\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.671012 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.670990    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.671069 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.671032    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8148107-369a-4b22-bed8-36d61cfe2434-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.677833 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.677787    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrsg5\" (UniqueName: \"kubernetes.io/projected/d8148107-369a-4b22-bed8-36d61cfe2434-kube-api-access-xrsg5\") pod \"telemeter-client-965f88b65-tb5ns\" (UID: \"d8148107-369a-4b22-bed8-36d61cfe2434\") " pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.828212 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.828116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns"
Jul 06 20:27:09.968596 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:09.968570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-965f88b65-tb5ns"]
Jul 06 20:27:09.970600 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:27:09.970574    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8148107_369a_4b22_bed8_36d61cfe2434.slice/crio-f4a3facbb7883adfd826974e6f3084feadd5169188dcfd622351812973bc3fcc WatchSource:0}: Error finding container f4a3facbb7883adfd826974e6f3084feadd5169188dcfd622351812973bc3fcc: Status 404 returned error can't find the container with id f4a3facbb7883adfd826974e6f3084feadd5169188dcfd622351812973bc3fcc
Jul 06 20:27:10.081898 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:10.081803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns" event={"ID":"d8148107-369a-4b22-bed8-36d61cfe2434","Type":"ContainerStarted","Data":"f4a3facbb7883adfd826974e6f3084feadd5169188dcfd622351812973bc3fcc"}
Jul 06 20:27:13.094773 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:13.094684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns" event={"ID":"d8148107-369a-4b22-bed8-36d61cfe2434","Type":"ContainerStarted","Data":"a8fc9e5449edf121192c441a05b787b7c1ff0f4d5e9806bb45ae8eb114f4ea1f"}
Jul 06 20:27:14.100823 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:14.100725    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns" event={"ID":"d8148107-369a-4b22-bed8-36d61cfe2434","Type":"ContainerStarted","Data":"b1e02c73330e0c6385b3008924c11c0a1fb531b3f822ede258e12409fe2ec258"}
Jul 06 20:27:14.100823 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:14.100794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns" event={"ID":"d8148107-369a-4b22-bed8-36d61cfe2434","Type":"ContainerStarted","Data":"c847a62c23625a54da535f07dba3127f36806b290dd10593b64961d925584e22"}
Jul 06 20:27:14.124448 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:14.124394    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-965f88b65-tb5ns" podStartSLOduration=1.30740788 podStartE2EDuration="5.12437461s" totalImagesPullingTime="3.81696673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:27:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:14.121856634 +0000 UTC m=+196.557509810" watchObservedRunningTime="2026-07-06 20:27:14.12437461 +0000 UTC m=+196.560027780"
Jul 06 20:27:15.259953 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.259917    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:27:15.262350 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.262329    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.264846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.264824    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 20:27:15.265248 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.265230    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 20:27:15.265347 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.265313    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 20:27:15.265880 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.265862    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 20:27:15.268162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.268134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g2hph\""
Jul 06 20:27:15.268260 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.268207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 20:27:15.271633 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.271612    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 20:27:15.276765 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.276742    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:27:15.319668 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvgc\" (UniqueName: \"kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.319997 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.319835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420318 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvgc\" (UniqueName: \"kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420318 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420318 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.420704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.420479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.421235 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.421210    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.421418 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.421392    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.421507 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.421435    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.421507 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.421480    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.423399 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.423381    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.423594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.423574    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.435545 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.435501    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvgc\" (UniqueName: \"kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc\") pod \"console-7f67794c9f-m8qbq\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") " pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.572536 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.572445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:15.706310 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:15.706281    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:27:15.708206 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:27:15.708183    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e275262_f315_4562_b090_3d819d699b27.slice/crio-50edda392e0a3a2df1a7124715186bc44a4e4e05f7929e7605280566497aa092 WatchSource:0}: Error finding container 50edda392e0a3a2df1a7124715186bc44a4e4e05f7929e7605280566497aa092: Status 404 returned error can't find the container with id 50edda392e0a3a2df1a7124715186bc44a4e4e05f7929e7605280566497aa092
Jul 06 20:27:16.110229 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:16.110192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67794c9f-m8qbq" event={"ID":"4e275262-f315-4562-b090-3d819d699b27","Type":"ContainerStarted","Data":"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"}
Jul 06 20:27:16.110433 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:16.110249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67794c9f-m8qbq" event={"ID":"4e275262-f315-4562-b090-3d819d699b27","Type":"ContainerStarted","Data":"50edda392e0a3a2df1a7124715186bc44a4e4e05f7929e7605280566497aa092"}
Jul 06 20:27:16.131440 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:16.131388    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f67794c9f-m8qbq" podStartSLOduration=1.131344975 podStartE2EDuration="1.131344975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:16.129966099 +0000 UTC m=+198.565619277" watchObservedRunningTime="2026-07-06 20:27:16.131344975 +0000 UTC m=+198.566998151"
Jul 06 20:27:25.573161 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:25.573119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:25.573587 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:25.573198    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:25.578102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:25.578079    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:27:26.155286 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:27:26.155256    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:28:42.449092 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.449052    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:28:42.451793 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.451775    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.470492 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.470455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:28:42.547351 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547351 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqkhh\" (UniqueName: \"kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.547664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.547610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648151 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648151 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648407 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqkhh\" (UniqueName: \"kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648464 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648464 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648559 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.648942 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.648907    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.649184 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.649165    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.649291 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.649204    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.649291 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.649241    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.650936 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.650906    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.650936 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.650931    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.657811 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.657785    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqkhh\" (UniqueName: \"kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh\") pod \"console-564c65db47-9kzcr\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") " pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.761605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.761520    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:42.907928 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:42.907793    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:28:42.910889 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:28:42.910861    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e3832e_cf41_4a74_b162_a3e2c77018b2.slice/crio-77b0b4d722d2c93f1f2d5656d2bb1d39d9cf917e822df0a32e0e73c2d7a7f7b6 WatchSource:0}: Error finding container 77b0b4d722d2c93f1f2d5656d2bb1d39d9cf917e822df0a32e0e73c2d7a7f7b6: Status 404 returned error can't find the container with id 77b0b4d722d2c93f1f2d5656d2bb1d39d9cf917e822df0a32e0e73c2d7a7f7b6
Jul 06 20:28:43.442859 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:43.442821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c65db47-9kzcr" event={"ID":"a8e3832e-cf41-4a74-b162-a3e2c77018b2","Type":"ContainerStarted","Data":"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"}
Jul 06 20:28:43.443074 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:43.442881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c65db47-9kzcr" event={"ID":"a8e3832e-cf41-4a74-b162-a3e2c77018b2","Type":"ContainerStarted","Data":"77b0b4d722d2c93f1f2d5656d2bb1d39d9cf917e822df0a32e0e73c2d7a7f7b6"}
Jul 06 20:28:43.462172 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:43.462114    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564c65db47-9kzcr" podStartSLOduration=1.4620962579999999 podStartE2EDuration="1.462096258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:28:43.460920211 +0000 UTC m=+285.896573392" watchObservedRunningTime="2026-07-06 20:28:43.462096258 +0000 UTC m=+285.897749435"
Jul 06 20:28:52.761942 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:52.761887    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:52.762512 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:52.761984    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:52.767327 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:52.767299    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:53.488186 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:53.488155    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:28:53.538233 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:53.538193    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:28:57.985948 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:28:57.985913    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 20:29:17.992271 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:17.992229    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"]
Jul 06 20:29:17.994763 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:17.994742    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:17.997280 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:17.997257    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 20:29:17.997392 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:17.997305    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 20:29:17.998194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:17.998175    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tl25\""
Jul 06 20:29:18.004769 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.004745    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"]
Jul 06 20:29:18.160119 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.160085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.160119 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.160124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.160333 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.160211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcs24\" (UniqueName: \"kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.261554 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.261458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcs24\" (UniqueName: \"kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.261554 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.261524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.261554 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.261548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.262006 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.261986    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.262006 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.261997    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.271926 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.271890    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcs24\" (UniqueName: \"kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.304125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.304083    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:18.440334 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.440309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"]
Jul 06 20:29:18.442704 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:29:18.442673    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d9f9b0_beec_4f49_b364_39dd18a0d3ae.slice/crio-e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55 WatchSource:0}: Error finding container e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55: Status 404 returned error can't find the container with id e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55
Jul 06 20:29:18.444664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.444650    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:29:18.565182 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.565080    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f67794c9f-m8qbq" podUID="4e275262-f315-4562-b090-3d819d699b27" containerName="console" containerID="cri-o://c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5" gracePeriod=15
Jul 06 20:29:18.581497 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.581469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerStarted","Data":"e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55"}
Jul 06 20:29:18.801893 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.801866    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:29:18.967607 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967571    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqvgc\" (UniqueName: \"kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.967801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.967801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967683    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.967801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967718    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.967801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967762    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.968021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967813    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.968021 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.967848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca\") pod \"4e275262-f315-4562-b090-3d819d699b27\" (UID: \"4e275262-f315-4562-b090-3d819d699b27\") "
Jul 06 20:29:18.968205 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.968158    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:29:18.968462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.968226    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config" (OuterVolumeSpecName: "console-config") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:29:18.968536 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.968453    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:29:18.968699 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.968674    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:29:18.970109 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.970081    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc" (OuterVolumeSpecName: "kube-api-access-tqvgc") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "kube-api-access-tqvgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:29:18.970232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.970179    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:29:18.970517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:18.970498    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e275262-f315-4562-b090-3d819d699b27" (UID: "4e275262-f315-4562-b090-3d819d699b27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:29:19.068964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068927    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvgc\" (UniqueName: \"kubernetes.io/projected/4e275262-f315-4562-b090-3d819d699b27-kube-api-access-tqvgc\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.068964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068958    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-oauth-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.068964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068969    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-oauth-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.069473 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068977    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e275262-f315-4562-b090-3d819d699b27-console-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.069473 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068986    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-console-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.069473 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.068998    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-trusted-ca-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.069473 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.069011    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e275262-f315-4562-b090-3d819d699b27-service-ca\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:19.588800 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.588708    2571 generic.go:356] "Generic (PLEG): container finished" podID="4e275262-f315-4562-b090-3d819d699b27" containerID="c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5" exitCode=0
Jul 06 20:29:19.588800 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.588750    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f67794c9f-m8qbq"
Jul 06 20:29:19.588800 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.588786    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67794c9f-m8qbq" event={"ID":"4e275262-f315-4562-b090-3d819d699b27","Type":"ContainerDied","Data":"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"}
Jul 06 20:29:19.589080 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.588845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f67794c9f-m8qbq" event={"ID":"4e275262-f315-4562-b090-3d819d699b27","Type":"ContainerDied","Data":"50edda392e0a3a2df1a7124715186bc44a4e4e05f7929e7605280566497aa092"}
Jul 06 20:29:19.589080 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.588901    2571 scope.go:117] "RemoveContainer" containerID="c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"
Jul 06 20:29:19.598045 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.598029    2571 scope.go:117] "RemoveContainer" containerID="c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"
Jul 06 20:29:19.598348 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:29:19.598330    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5\": container with ID starting with c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5 not found: ID does not exist" containerID="c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"
Jul 06 20:29:19.598413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.598389    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5"} err="failed to get container status \"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5\": rpc error: code = NotFound desc = could not find container \"c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5\": container with ID starting with c0e0251a9d387f7b3818f75740e06237cac0c1a75a46eb5fd0770d018dd6f7f5 not found: ID does not exist"
Jul 06 20:29:19.610192 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.610161    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:29:19.617952 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:19.617919    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f67794c9f-m8qbq"]
Jul 06 20:29:20.176143 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:20.176108    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e275262-f315-4562-b090-3d819d699b27" path="/var/lib/kubelet/pods/4e275262-f315-4562-b090-3d819d699b27/volumes"
Jul 06 20:29:26.623348 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:26.623316    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerID="de4edf77c6c7c9ce105148a2d282fa4c939db2dbdebfdda6978496e7275d5efd" exitCode=0
Jul 06 20:29:26.623794 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:26.623407    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerDied","Data":"de4edf77c6c7c9ce105148a2d282fa4c939db2dbdebfdda6978496e7275d5efd"}
Jul 06 20:29:29.639608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:29.639577    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerID="8b78fe54f9bded3b5b22a2de70aa37a9cb950067fc85813eab7cb8c52f0d068b" exitCode=0
Jul 06 20:29:29.640033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:29.639667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerDied","Data":"8b78fe54f9bded3b5b22a2de70aa37a9cb950067fc85813eab7cb8c52f0d068b"}
Jul 06 20:29:41.694000 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:41.693955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerStarted","Data":"fb6905bf334a3a9052d411039d9c35962aeb78face8a81eef37fb5b7c42342c8"}
Jul 06 20:29:41.714529 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:41.714428    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" podStartSLOduration=2.947647598 podStartE2EDuration="24.714411635s" totalImagesPullingTime="21.766764037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:29:41.712743023 +0000 UTC m=+344.148396223" watchObservedRunningTime="2026-07-06 20:29:41.714411635 +0000 UTC m=+344.150064813"
Jul 06 20:29:42.700279 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:42.700247    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerID="fb6905bf334a3a9052d411039d9c35962aeb78face8a81eef37fb5b7c42342c8" exitCode=0
Jul 06 20:29:42.700704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:42.700340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerDied","Data":"fb6905bf334a3a9052d411039d9c35962aeb78face8a81eef37fb5b7c42342c8"}
Jul 06 20:29:43.832079 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.832057    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:43.891106 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.891074    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle\") pod \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") "
Jul 06 20:29:43.891289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.891140    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util\") pod \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") "
Jul 06 20:29:43.891289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.891185    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcs24\" (UniqueName: \"kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24\") pod \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\" (UID: \"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae\") "
Jul 06 20:29:43.891754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.891731    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle" (OuterVolumeSpecName: "bundle") pod "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" (UID: "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:29:43.893584 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.893559    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24" (OuterVolumeSpecName: "kube-api-access-pcs24") pod "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" (UID: "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae"). InnerVolumeSpecName "kube-api-access-pcs24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:29:43.895010 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.894988    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util" (OuterVolumeSpecName: "util") pod "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" (UID: "c7d9f9b0-beec-4f49-b364-39dd18a0d3ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:29:43.992752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.992669    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:43.992752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.992700    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcs24\" (UniqueName: \"kubernetes.io/projected/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-kube-api-access-pcs24\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:43.992752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:43.992710    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d9f9b0-beec-4f49-b364-39dd18a0d3ae-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:29:44.710117 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:44.710090    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck"
Jul 06 20:29:44.710285 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:44.710086    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n2xck" event={"ID":"c7d9f9b0-beec-4f49-b364-39dd18a0d3ae","Type":"ContainerDied","Data":"e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55"}
Jul 06 20:29:44.710285 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:44.710205    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e96a8afc0fb07f210f7bf68a57132e4681ea3bbecf4df7c0ece1827a04584a55"
Jul 06 20:29:51.577424 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577317    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"]
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577765    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="pull"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577783    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="pull"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577801    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="extract"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577809    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="extract"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577820    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e275262-f315-4562-b090-3d819d699b27" containerName="console"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577829    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e275262-f315-4562-b090-3d819d699b27" containerName="console"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577842    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="util"
Jul 06 20:29:51.577892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577849    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="util"
Jul 06 20:29:51.578283 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577948    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e275262-f315-4562-b090-3d819d699b27" containerName="console"
Jul 06 20:29:51.578283 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.577961    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d9f9b0-beec-4f49-b364-39dd18a0d3ae" containerName="extract"
Jul 06 20:29:51.579915 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.579895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.582467 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.582447    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:29:51.587078 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.583602    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 20:29:51.587078 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.583658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qr2lr\""
Jul 06 20:29:51.599705 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.599669    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"]
Jul 06 20:29:51.660003 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.659965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d3126ef-54f2-47ba-a6e9-f528c792784e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.660171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.660026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9nd\" (UniqueName: \"kubernetes.io/projected/3d3126ef-54f2-47ba-a6e9-f528c792784e-kube-api-access-nz9nd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.761269 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.761232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9nd\" (UniqueName: \"kubernetes.io/projected/3d3126ef-54f2-47ba-a6e9-f528c792784e-kube-api-access-nz9nd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.761484 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.761299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d3126ef-54f2-47ba-a6e9-f528c792784e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.761677 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.761658    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d3126ef-54f2-47ba-a6e9-f528c792784e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.771014 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.770978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9nd\" (UniqueName: \"kubernetes.io/projected/3d3126ef-54f2-47ba-a6e9-f528c792784e-kube-api-access-nz9nd\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt4l5\" (UID: \"3d3126ef-54f2-47ba-a6e9-f528c792784e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:51.891134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:51.891097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"
Jul 06 20:29:52.034527 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:52.034502    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5"]
Jul 06 20:29:52.037496 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:29:52.037452    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3126ef_54f2_47ba_a6e9_f528c792784e.slice/crio-efebd8038318dbc726981b895b218de32abe76d91d25d6da82ac8122649e79b9 WatchSource:0}: Error finding container efebd8038318dbc726981b895b218de32abe76d91d25d6da82ac8122649e79b9: Status 404 returned error can't find the container with id efebd8038318dbc726981b895b218de32abe76d91d25d6da82ac8122649e79b9
Jul 06 20:29:52.744648 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:52.744614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5" event={"ID":"3d3126ef-54f2-47ba-a6e9-f528c792784e","Type":"ContainerStarted","Data":"efebd8038318dbc726981b895b218de32abe76d91d25d6da82ac8122649e79b9"}
Jul 06 20:29:54.755233 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:54.755194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5" event={"ID":"3d3126ef-54f2-47ba-a6e9-f528c792784e","Type":"ContainerStarted","Data":"6865963c11d296e5b12c4fbbf51383b54dbeae302e21bffbf434c0764746cc1f"}
Jul 06 20:29:54.836879 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:54.836819    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt4l5" podStartSLOduration=1.77880824 podStartE2EDuration="3.836800875s" totalImagesPullingTime="2.057992635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:29:54.834504284 +0000 UTC m=+357.270157461" watchObservedRunningTime="2026-07-06 20:29:54.836800875 +0000 UTC m=+357.272454053"
Jul 06 20:29:56.182461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.182425    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"]
Jul 06 20:29:56.184964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.184946    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.189727 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.189698    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 20:29:56.189727 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.189698    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tl25\""
Jul 06 20:29:56.189922 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.189750    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 20:29:56.202279 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.202247    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"]
Jul 06 20:29:56.302033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.301986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.302033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.302028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmqs\" (UniqueName: \"kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.302238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.302048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.402982 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.402941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.403189 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.403024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.403189 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.403044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmqs\" (UniqueName: \"kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.403434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.403410    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.403434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.403425    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.414734 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.414702    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmqs\" (UniqueName: \"kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.494792 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.494703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:29:56.638674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.638634    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"]
Jul 06 20:29:56.642814 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:29:56.642774    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55222e01_2da7_48fb_8d71_1e5c8c6f7233.slice/crio-4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249 WatchSource:0}: Error finding container 4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249: Status 404 returned error can't find the container with id 4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249
Jul 06 20:29:56.765507 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.765421    2571 generic.go:356] "Generic (PLEG): container finished" podID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerID="5d4df7c8e3cb832478375c6da5d0ffdfa2fb7eafe4e9d30b7c372b59e4da0ddc" exitCode=0
Jul 06 20:29:56.765507 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.765477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerDied","Data":"5d4df7c8e3cb832478375c6da5d0ffdfa2fb7eafe4e9d30b7c372b59e4da0ddc"}
Jul 06 20:29:56.765679 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:56.765545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerStarted","Data":"4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249"}
Jul 06 20:29:57.280199 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.280161    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-44g8x"]
Jul 06 20:29:57.282523 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.282504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.286140 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.285761    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sv87h\""
Jul 06 20:29:57.286910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.286884    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 20:29:57.287050 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.286918    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 20:29:57.306967 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.306932    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-44g8x"]
Jul 06 20:29:57.411505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.411468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.411665 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.411522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8pq7\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-kube-api-access-g8pq7\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.513026 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.512988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.513223 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.513044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8pq7\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-kube-api-access-g8pq7\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.523437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.523403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.523577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.523544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8pq7\" (UniqueName: \"kubernetes.io/projected/b3f52140-412c-43a8-b447-126112ca1389-kube-api-access-g8pq7\") pod \"cert-manager-webhook-6486ffd997-44g8x\" (UID: \"b3f52140-412c-43a8-b447-126112ca1389\") " pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.600768 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.600666    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:29:57.771262 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:57.771236    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-44g8x"]
Jul 06 20:29:57.773892 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:29:57.773867    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3f52140_412c_43a8_b447_126112ca1389.slice/crio-57baa785d3fbc074cbef8edc6ecfde22aff94ee391afe6e3eea21400920942eb WatchSource:0}: Error finding container 57baa785d3fbc074cbef8edc6ecfde22aff94ee391afe6e3eea21400920942eb: Status 404 returned error can't find the container with id 57baa785d3fbc074cbef8edc6ecfde22aff94ee391afe6e3eea21400920942eb
Jul 06 20:29:58.779163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:58.779122    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x" event={"ID":"b3f52140-412c-43a8-b447-126112ca1389","Type":"ContainerStarted","Data":"57baa785d3fbc074cbef8edc6ecfde22aff94ee391afe6e3eea21400920942eb"}
Jul 06 20:29:59.786025 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:59.785983    2571 generic.go:356] "Generic (PLEG): container finished" podID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerID="3fe3e05fa28be321b2a4028da6090699984a5ddd78d8757a613701f9093da9b8" exitCode=0
Jul 06 20:29:59.786442 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:29:59.786067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerDied","Data":"3fe3e05fa28be321b2a4028da6090699984a5ddd78d8757a613701f9093da9b8"}
Jul 06 20:30:00.794298 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:00.794260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerStarted","Data":"5fb31b5ca66dd85ea4ab34f42673099b4c43234fc883b00b53fa623d8af4bf43"}
Jul 06 20:30:00.821742 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:00.821689    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" podStartSLOduration=2.658963683 podStartE2EDuration="4.821668243s" totalImagesPullingTime="2.16270456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:00.820513835 +0000 UTC m=+363.256167042" watchObservedRunningTime="2026-07-06 20:30:00.821668243 +0000 UTC m=+363.257321421"
Jul 06 20:30:01.800493 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:01.800454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x" event={"ID":"b3f52140-412c-43a8-b447-126112ca1389","Type":"ContainerStarted","Data":"af2197a22fd92b4cf09c932978e6ebdd3635925a18550aff31faa924639614f0"}
Jul 06 20:30:01.800943 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:01.800596    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:30:01.802451 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:01.802423    2571 generic.go:356] "Generic (PLEG): container finished" podID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerID="5fb31b5ca66dd85ea4ab34f42673099b4c43234fc883b00b53fa623d8af4bf43" exitCode=0
Jul 06 20:30:01.802556 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:01.802458    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerDied","Data":"5fb31b5ca66dd85ea4ab34f42673099b4c43234fc883b00b53fa623d8af4bf43"}
Jul 06 20:30:01.829015 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:01.828965    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x" podStartSLOduration=1.8680109900000001 podStartE2EDuration="4.828948127s" totalImagesPullingTime="2.960937137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:01.827857319 +0000 UTC m=+364.263510491" watchObservedRunningTime="2026-07-06 20:30:01.828948127 +0000 UTC m=+364.264601304"
Jul 06 20:30:02.936590 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:02.936561    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:30:03.057988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.057887    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle\") pod \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") "
Jul 06 20:30:03.057988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.057975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util\") pod \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") "
Jul 06 20:30:03.058168 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.058010    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qmqs\" (UniqueName: \"kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs\") pod \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\" (UID: \"55222e01-2da7-48fb-8d71-1e5c8c6f7233\") "
Jul 06 20:30:03.058405 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.058347    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle" (OuterVolumeSpecName: "bundle") pod "55222e01-2da7-48fb-8d71-1e5c8c6f7233" (UID: "55222e01-2da7-48fb-8d71-1e5c8c6f7233"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.060241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.060214    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs" (OuterVolumeSpecName: "kube-api-access-4qmqs") pod "55222e01-2da7-48fb-8d71-1e5c8c6f7233" (UID: "55222e01-2da7-48fb-8d71-1e5c8c6f7233"). InnerVolumeSpecName "kube-api-access-4qmqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:03.062588 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.062554    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util" (OuterVolumeSpecName: "util") pod "55222e01-2da7-48fb-8d71-1e5c8c6f7233" (UID: "55222e01-2da7-48fb-8d71-1e5c8c6f7233"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:03.159490 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.159452    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.159490 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.159483    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qmqs\" (UniqueName: \"kubernetes.io/projected/55222e01-2da7-48fb-8d71-1e5c8c6f7233-kube-api-access-4qmqs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.159490 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.159495    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55222e01-2da7-48fb-8d71-1e5c8c6f7233-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:03.813178 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.813154    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh"
Jul 06 20:30:03.813349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.813192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs8rbh" event={"ID":"55222e01-2da7-48fb-8d71-1e5c8c6f7233","Type":"ContainerDied","Data":"4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249"}
Jul 06 20:30:03.813349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:03.813233    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e9ed7318f06d02424859b51200bf736a6cc90a25407b3b460b1329986016249"
Jul 06 20:30:07.809327 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:07.809299    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-44g8x"
Jul 06 20:30:16.283481 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283450    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"]
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283774    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="pull"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283785    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="pull"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283796    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="util"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283801    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="util"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283820    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="extract"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283825    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="extract"
Jul 06 20:30:16.283927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.283890    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="55222e01-2da7-48fb-8d71-1e5c8c6f7233" containerName="extract"
Jul 06 20:30:16.288599 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.288577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.291401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.291373    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 20:30:16.291401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.291394    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 20:30:16.291620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.291394    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5tl25\""
Jul 06 20:30:16.295434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.295408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"]
Jul 06 20:30:16.473230 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.473190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7cn9\" (UniqueName: \"kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.473230 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.473245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.473493 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.473317    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.574642 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.574550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.574642 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.574594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.574835 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.574656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7cn9\" (UniqueName: \"kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.574959 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.574938    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.574997 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.574976    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.583481 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.583446    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7cn9\" (UniqueName: \"kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.599456 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.599423    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:16.736540 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.736512    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"]
Jul 06 20:30:16.739145 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:16.739112    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e73cec_9ac2_4497_860b_01a0f3bda8c8.slice/crio-202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989 WatchSource:0}: Error finding container 202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989: Status 404 returned error can't find the container with id 202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989
Jul 06 20:30:16.872633 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.872603    2571 generic.go:356] "Generic (PLEG): container finished" podID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerID="637a2cf1f590340915c7d99dedf66fa7b2899e250a7f6bf500f39fa36f2b9614" exitCode=0
Jul 06 20:30:16.872800 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.872644    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw" event={"ID":"d9e73cec-9ac2-4497-860b-01a0f3bda8c8","Type":"ContainerDied","Data":"637a2cf1f590340915c7d99dedf66fa7b2899e250a7f6bf500f39fa36f2b9614"}
Jul 06 20:30:16.872800 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:16.872693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw" event={"ID":"d9e73cec-9ac2-4497-860b-01a0f3bda8c8","Type":"ContainerStarted","Data":"202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989"}
Jul 06 20:30:17.878742 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:17.878709    2571 generic.go:356] "Generic (PLEG): container finished" podID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerID="47c285943a04cc161df04cf47f6b5491bf5f938d7ffe2e6f7f5c5fbe69a27996" exitCode=0
Jul 06 20:30:17.879117 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:17.878761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw" event={"ID":"d9e73cec-9ac2-4497-860b-01a0f3bda8c8","Type":"ContainerDied","Data":"47c285943a04cc161df04cf47f6b5491bf5f938d7ffe2e6f7f5c5fbe69a27996"}
Jul 06 20:30:18.885505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:18.885469    2571 generic.go:356] "Generic (PLEG): container finished" podID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerID="3bea284c05402c7e8a5d628c5ef2608f29d11bd905c9fe538f4c8123b271292b" exitCode=0
Jul 06 20:30:18.885907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:18.885543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw" event={"ID":"d9e73cec-9ac2-4497-860b-01a0f3bda8c8","Type":"ContainerDied","Data":"3bea284c05402c7e8a5d628c5ef2608f29d11bd905c9fe538f4c8123b271292b"}
Jul 06 20:30:20.017735 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.017705    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:20.204193 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.204104    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7cn9\" (UniqueName: \"kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9\") pod \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") "
Jul 06 20:30:20.204193 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.204162    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle\") pod \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") "
Jul 06 20:30:20.204193 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.204178    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util\") pod \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\" (UID: \"d9e73cec-9ac2-4497-860b-01a0f3bda8c8\") "
Jul 06 20:30:20.204961 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.204933    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle" (OuterVolumeSpecName: "bundle") pod "d9e73cec-9ac2-4497-860b-01a0f3bda8c8" (UID: "d9e73cec-9ac2-4497-860b-01a0f3bda8c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:20.206329 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.206305    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9" (OuterVolumeSpecName: "kube-api-access-c7cn9") pod "d9e73cec-9ac2-4497-860b-01a0f3bda8c8" (UID: "d9e73cec-9ac2-4497-860b-01a0f3bda8c8"). InnerVolumeSpecName "kube-api-access-c7cn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:20.210017 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.209987    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util" (OuterVolumeSpecName: "util") pod "d9e73cec-9ac2-4497-860b-01a0f3bda8c8" (UID: "d9e73cec-9ac2-4497-860b-01a0f3bda8c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:20.305168 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.305133    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7cn9\" (UniqueName: \"kubernetes.io/projected/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-kube-api-access-c7cn9\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:20.305168 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.305163    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:20.305168 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.305174    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9e73cec-9ac2-4497-860b-01a0f3bda8c8-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:30:20.896781 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.896745    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw" event={"ID":"d9e73cec-9ac2-4497-860b-01a0f3bda8c8","Type":"ContainerDied","Data":"202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989"}
Jul 06 20:30:20.896781 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.896763    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqxnnw"
Jul 06 20:30:20.896990 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:20.896795    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="202c4cd7beeb9d0c1628e4494bde0c6f5d0cdca2a57e4712208fd764359ad989"
Jul 06 20:30:30.476740 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.476706    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"]
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477052    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="pull"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477066    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="pull"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477078    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="extract"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477085    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="extract"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477092    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="util"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477098    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="util"
Jul 06 20:30:30.477148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.477147    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e73cec-9ac2-4497-860b-01a0f3bda8c8" containerName="extract"
Jul 06 20:30:30.479408 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.479390    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.483525 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.483500    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 20:30:30.500963 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.500932    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 20:30:30.500963 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.500933    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 20:30:30.502581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.502565    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l66h4\""
Jul 06 20:30:30.502638 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.502605    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 20:30:30.538838 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.538807    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"]
Jul 06 20:30:30.586116 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.586073    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.586289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.586134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-manifests\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.586289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.586188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-tmp\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.586289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.586207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.586289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.586223    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p57sv\" (UniqueName: \"kubernetes.io/projected/5ff43133-2a17-4a24-bf82-132cef61afd5-kube-api-access-p57sv\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687041 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-manifests\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687041 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-tmp\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687272 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687272 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p57sv\" (UniqueName: \"kubernetes.io/projected/5ff43133-2a17-4a24-bf82-132cef61afd5-kube-api-access-p57sv\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687343 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.687445 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.687424    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-manifests\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.689497 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.689472    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ff43133-2a17-4a24-bf82-132cef61afd5-tmp\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.689620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.689552    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-webhook-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.689674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.689641    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ff43133-2a17-4a24-bf82-132cef61afd5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.704575 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.704543    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p57sv\" (UniqueName: \"kubernetes.io/projected/5ff43133-2a17-4a24-bf82-132cef61afd5-kube-api-access-p57sv\") pod \"opendatahub-operator-controller-manager-656f947554-2rv94\" (UID: \"5ff43133-2a17-4a24-bf82-132cef61afd5\") " pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.790115 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.790024    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:30.943891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:30.943868    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"]
Jul 06 20:30:30.946031 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:30.946002    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff43133_2a17_4a24_bf82_132cef61afd5.slice/crio-37dd41de05d21fa3a9a6bf0858a52ae37e341c80e6f2f48b453267b35843412d WatchSource:0}: Error finding container 37dd41de05d21fa3a9a6bf0858a52ae37e341c80e6f2f48b453267b35843412d: Status 404 returned error can't find the container with id 37dd41de05d21fa3a9a6bf0858a52ae37e341c80e6f2f48b453267b35843412d
Jul 06 20:30:31.950951 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:31.950871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94" event={"ID":"5ff43133-2a17-4a24-bf82-132cef61afd5","Type":"ContainerStarted","Data":"37dd41de05d21fa3a9a6bf0858a52ae37e341c80e6f2f48b453267b35843412d"}
Jul 06 20:30:33.962036 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:33.961998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94" event={"ID":"5ff43133-2a17-4a24-bf82-132cef61afd5","Type":"ContainerStarted","Data":"556b034888cdbdf9c6587063a231b5ab973969574be49fedb732f41c5f825678"}
Jul 06 20:30:35.973714 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:35.973680    2571 generic.go:356] "Generic (PLEG): container finished" podID="5ff43133-2a17-4a24-bf82-132cef61afd5" containerID="556b034888cdbdf9c6587063a231b5ab973969574be49fedb732f41c5f825678" exitCode=0
Jul 06 20:30:35.974110 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:35.973729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94" event={"ID":"5ff43133-2a17-4a24-bf82-132cef61afd5","Type":"ContainerDied","Data":"556b034888cdbdf9c6587063a231b5ab973969574be49fedb732f41c5f825678"}
Jul 06 20:30:36.980031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:36.979996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94" event={"ID":"5ff43133-2a17-4a24-bf82-132cef61afd5","Type":"ContainerStarted","Data":"6ce8a7275044f84bfe2501d3863ce78832f4857e495866ad4646c1411421ef71"}
Jul 06 20:30:36.980458 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:36.980311    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:47.986830 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:47.986799    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94"
Jul 06 20:30:48.015019 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:48.014950    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-656f947554-2rv94" podStartSLOduration=13.468882048 podStartE2EDuration="18.014926661s" totalImagesPullingTime="3.503964338s" totalInitContainerRuntime="1.042080275s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:37.018140165 +0000 UTC m=+399.453793360" watchObservedRunningTime="2026-07-06 20:30:48.014926661 +0000 UTC m=+410.450579838"
Jul 06 20:30:50.906548 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.906513    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"]
Jul 06 20:30:50.909534 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.909514    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:50.913895 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.913871    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 20:30:50.914171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.914158    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qrt85\""
Jul 06 20:30:50.915947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.915930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 20:30:50.935269 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.935237    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"]
Jul 06 20:30:50.956838 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.956805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xm8q\" (UniqueName: \"kubernetes.io/projected/66326720-8f75-447a-bdce-054c90ee031e-kube-api-access-7xm8q\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:50.956838 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.956848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66326720-8f75-447a-bdce-054c90ee031e-tls-certs\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:50.957058 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:50.956874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66326720-8f75-447a-bdce-054c90ee031e-tmp\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.037572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.037538    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r65z8"]
Jul 06 20:30:51.040676 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.040651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.043323 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.043294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hhg2f\""
Jul 06 20:30:51.043323 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.043294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 20:30:51.057908 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.057874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xm8q\" (UniqueName: \"kubernetes.io/projected/66326720-8f75-447a-bdce-054c90ee031e-kube-api-access-7xm8q\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.058084 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.057919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66326720-8f75-447a-bdce-054c90ee031e-tls-certs\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.058084 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.057946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66326720-8f75-447a-bdce-054c90ee031e-tmp\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.060188 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.060151    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66326720-8f75-447a-bdce-054c90ee031e-tmp\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.060381 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.060345    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66326720-8f75-447a-bdce-054c90ee031e-tls-certs\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.065308 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.065282    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r65z8"]
Jul 06 20:30:51.087528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.087496    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xm8q\" (UniqueName: \"kubernetes.io/projected/66326720-8f75-447a-bdce-054c90ee031e-kube-api-access-7xm8q\") pod \"kube-auth-proxy-65d4f4589-bt6gs\" (UID: \"66326720-8f75-447a-bdce-054c90ee031e\") " pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.159056 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.158961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.159056 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.159038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9s4n\" (UniqueName: \"kubernetes.io/projected/4d90bfa7-03b6-4d72-9837-4193530b77aa-kube-api-access-r9s4n\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.219743 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.219706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"
Jul 06 20:30:51.260402 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.260120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9s4n\" (UniqueName: \"kubernetes.io/projected/4d90bfa7-03b6-4d72-9837-4193530b77aa-kube-api-access-r9s4n\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.260402 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.260201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.260402 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:30:51.260385    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 20:30:51.260663 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:30:51.260466    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert podName:4d90bfa7-03b6-4d72-9837-4193530b77aa nodeName:}" failed. No retries permitted until 2026-07-06 20:30:51.76044716 +0000 UTC m=+414.196100319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert") pod "odh-model-controller-7998c67dc4-r65z8" (UID: "4d90bfa7-03b6-4d72-9837-4193530b77aa") : secret "odh-model-controller-webhook-cert" not found
Jul 06 20:30:51.275016 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.274986    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9s4n\" (UniqueName: \"kubernetes.io/projected/4d90bfa7-03b6-4d72-9837-4193530b77aa-kube-api-access-r9s4n\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.380658 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:51.380624    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66326720_8f75_447a_bdce_054c90ee031e.slice/crio-61f69fbdd36db49a2c6cd81d1b9bb9cc7fe368adb761572971bc575ee2edb49a WatchSource:0}: Error finding container 61f69fbdd36db49a2c6cd81d1b9bb9cc7fe368adb761572971bc575ee2edb49a: Status 404 returned error can't find the container with id 61f69fbdd36db49a2c6cd81d1b9bb9cc7fe368adb761572971bc575ee2edb49a
Jul 06 20:30:51.392543 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.392513    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs"]
Jul 06 20:30:51.765668 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.765627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.767965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.767946    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d90bfa7-03b6-4d72-9837-4193530b77aa-cert\") pod \"odh-model-controller-7998c67dc4-r65z8\" (UID: \"4d90bfa7-03b6-4d72-9837-4193530b77aa\") " pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.951851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.951816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:51.965427 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.965399    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p4pj5"]
Jul 06 20:30:51.968872 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.968844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:51.972611 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:51.972592    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 20:30:52.007669 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.007584    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p4pj5"]
Jul 06 20:30:52.054437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.054382    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs" event={"ID":"66326720-8f75-447a-bdce-054c90ee031e","Type":"ContainerStarted","Data":"61f69fbdd36db49a2c6cd81d1b9bb9cc7fe368adb761572971bc575ee2edb49a"}
Jul 06 20:30:52.070143 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.068743    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvkg5\" (UniqueName: \"kubernetes.io/projected/ed5286f2-fb24-4eab-bd91-0100dbd64365-kube-api-access-xvkg5\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.070143 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.068844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.147921 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.147892    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-r65z8"]
Jul 06 20:30:52.150971 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:52.150939    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d90bfa7_03b6_4d72_9837_4193530b77aa.slice/crio-c44503d8c9f933f6fee2c271811f49e1db77c886e4f301f134611b3cafcdd814 WatchSource:0}: Error finding container c44503d8c9f933f6fee2c271811f49e1db77c886e4f301f134611b3cafcdd814: Status 404 returned error can't find the container with id c44503d8c9f933f6fee2c271811f49e1db77c886e4f301f134611b3cafcdd814
Jul 06 20:30:52.169327 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.169290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.169525 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.169402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvkg5\" (UniqueName: \"kubernetes.io/projected/ed5286f2-fb24-4eab-bd91-0100dbd64365-kube-api-access-xvkg5\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.169525 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:30:52.169483    2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 20:30:52.169608 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:30:52.169555    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs podName:ed5286f2-fb24-4eab-bd91-0100dbd64365 nodeName:}" failed. No retries permitted until 2026-07-06 20:30:52.669534844 +0000 UTC m=+415.105188018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs") pod "model-serving-api-54d89bd5fc-p4pj5" (UID: "ed5286f2-fb24-4eab-bd91-0100dbd64365") : secret "model-serving-api-tls" not found
Jul 06 20:30:52.181529 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.181496    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvkg5\" (UniqueName: \"kubernetes.io/projected/ed5286f2-fb24-4eab-bd91-0100dbd64365-kube-api-access-xvkg5\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.674805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.674719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.677512 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.677445    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed5286f2-fb24-4eab-bd91-0100dbd64365-tls-certs\") pod \"model-serving-api-54d89bd5fc-p4pj5\" (UID: \"ed5286f2-fb24-4eab-bd91-0100dbd64365\") " pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:52.880501 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:52.880435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:53.060427 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:53.060389    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8" event={"ID":"4d90bfa7-03b6-4d72-9837-4193530b77aa","Type":"ContainerStarted","Data":"c44503d8c9f933f6fee2c271811f49e1db77c886e4f301f134611b3cafcdd814"}
Jul 06 20:30:53.070862 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:53.070785    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-p4pj5"]
Jul 06 20:30:53.072448 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:53.072410    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5286f2_fb24_4eab_bd91_0100dbd64365.slice/crio-e684d1c6dfc812f67ef6f62774b483cbe5783473b8fe08086bd2de9cbd43b2d7 WatchSource:0}: Error finding container e684d1c6dfc812f67ef6f62774b483cbe5783473b8fe08086bd2de9cbd43b2d7: Status 404 returned error can't find the container with id e684d1c6dfc812f67ef6f62774b483cbe5783473b8fe08086bd2de9cbd43b2d7
Jul 06 20:30:54.067274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:54.067239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5" event={"ID":"ed5286f2-fb24-4eab-bd91-0100dbd64365","Type":"ContainerStarted","Data":"e684d1c6dfc812f67ef6f62774b483cbe5783473b8fe08086bd2de9cbd43b2d7"}
Jul 06 20:30:56.937508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:56.937471    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"]
Jul 06 20:30:56.941675 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:56.941651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:56.944663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:56.944637    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 20:30:56.944791 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:56.944691    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4vthw\""
Jul 06 20:30:56.966435 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:56.966385    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"]
Jul 06 20:30:57.017546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cg6q\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-kube-api-access-2cg6q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017686    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24203ffa-c913-4942-9e1d-7467025ffd90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017844 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017844 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24203ffa-c913-4942-9e1d-7467025ffd90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017844 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.017938 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.017888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.085030 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.084974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs" event={"ID":"66326720-8f75-447a-bdce-054c90ee031e","Type":"ContainerStarted","Data":"75e432c33f0948c194478a89d73bebfa018d61c1597681bfdab95fd478cadbaa"}
Jul 06 20:30:57.086857 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.086824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8" event={"ID":"4d90bfa7-03b6-4d72-9837-4193530b77aa","Type":"ContainerStarted","Data":"7e7a22487646b0ebbd6d7e9c0978229a5a5f84b06ab2a635b0337e80da14cbf3"}
Jul 06 20:30:57.087074 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.086905    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:30:57.088617 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.088581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5" event={"ID":"ed5286f2-fb24-4eab-bd91-0100dbd64365","Type":"ContainerStarted","Data":"18849fbad6d49aa8263e41f5629d796ca590bf0d63f7abe677cf001a035db27c"}
Jul 06 20:30:57.088747 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.088705    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:30:57.119052 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24203ffa-c913-4942-9e1d-7467025ffd90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24203ffa-c913-4942-9e1d-7467025ffd90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119263 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119711 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119711 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cg6q\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-kube-api-access-2cg6q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119711 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119522    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119903 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119878    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.119988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119930    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.120051 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.119981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.120204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.120176    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24203ffa-c913-4942-9e1d-7467025ffd90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.122083 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.122061    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24203ffa-c913-4942-9e1d-7467025ffd90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.122183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.122168    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24203ffa-c913-4942-9e1d-7467025ffd90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.134214 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.134165    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65d4f4589-bt6gs" podStartSLOduration=2.201639648 podStartE2EDuration="7.134149537s" totalImagesPullingTime="4.932509889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:57.131958526 +0000 UTC m=+419.567611704" watchObservedRunningTime="2026-07-06 20:30:57.134149537 +0000 UTC m=+419.569802728"
Jul 06 20:30:57.137236 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.137208    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cg6q\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-kube-api-access-2cg6q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.138196 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.138178    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24203ffa-c913-4942-9e1d-7467025ffd90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4pvc7t\" (UID: \"24203ffa-c913-4942-9e1d-7467025ffd90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.171684 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.171626    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8" podStartSLOduration=2.998118315 podStartE2EDuration="7.171610978s" totalImagesPullingTime="4.173492663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:57.169624189 +0000 UTC m=+419.605277367" watchObservedRunningTime="2026-07-06 20:30:57.171610978 +0000 UTC m=+419.607264154"
Jul 06 20:30:57.211069 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.210966    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5" podStartSLOduration=2.9711071970000003 podStartE2EDuration="6.210947229s" totalImagesPullingTime="3.239840032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:57.207785842 +0000 UTC m=+419.643439020" watchObservedRunningTime="2026-07-06 20:30:57.210947229 +0000 UTC m=+419.646600406"
Jul 06 20:30:57.252510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.252465    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:30:57.404029 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:57.403835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"]
Jul 06 20:30:57.406821 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:30:57.406786    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24203ffa_c913_4942_9e1d_7467025ffd90.slice/crio-8a77f389ea474321b47c7e40fc32e8f35443aaff6cefdbfdd5b751bc5d8d07ac WatchSource:0}: Error finding container 8a77f389ea474321b47c7e40fc32e8f35443aaff6cefdbfdd5b751bc5d8d07ac: Status 404 returned error can't find the container with id 8a77f389ea474321b47c7e40fc32e8f35443aaff6cefdbfdd5b751bc5d8d07ac
Jul 06 20:30:58.095019 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:58.094976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t" event={"ID":"24203ffa-c913-4942-9e1d-7467025ffd90","Type":"ContainerStarted","Data":"8a77f389ea474321b47c7e40fc32e8f35443aaff6cefdbfdd5b751bc5d8d07ac"}
Jul 06 20:30:59.873198 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.873164    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"]
Jul 06 20:30:59.878198 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.878172    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.885384 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.885341    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 20:30:59.885517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.885500    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 20:30:59.886457 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.886439    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bwmhq\""
Jul 06 20:30:59.893110 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.893087    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 20:30:59.910853 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.910819    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"]
Jul 06 20:30:59.943298 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05603ad7-9c84-4e48-b3d9-06cceb92d13e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943298 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnhw\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-kube-api-access-mcnhw\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:30:59.943657 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:30:59.943575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.044995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.044962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05603ad7-9c84-4e48-b3d9-06cceb92d13e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.044995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.044997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045253 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045253 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045253 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045253 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnhw\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-kube-api-access-mcnhw\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045278    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.045988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.045959    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.047581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.047551    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.047700 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.047592    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.048437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.048410    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/05603ad7-9c84-4e48-b3d9-06cceb92d13e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.048589 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.048569    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/05603ad7-9c84-4e48-b3d9-06cceb92d13e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.063971 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.063938    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.064109 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.064087    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnhw\" (UniqueName: \"kubernetes.io/projected/05603ad7-9c84-4e48-b3d9-06cceb92d13e-kube-api-access-mcnhw\") pod \"istiod-openshift-gateway-94bb8fbfd-5vvx9\" (UID: \"05603ad7-9c84-4e48-b3d9-06cceb92d13e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.187751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.187650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:00.333300 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:00.333271    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"]
Jul 06 20:31:00.335901 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:31:00.335873    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05603ad7_9c84_4e48_b3d9_06cceb92d13e.slice/crio-6729478bd794f461f60d3a8114e54489f974213de71a47200d0c5ce1c04d8101 WatchSource:0}: Error finding container 6729478bd794f461f60d3a8114e54489f974213de71a47200d0c5ce1c04d8101: Status 404 returned error can't find the container with id 6729478bd794f461f60d3a8114e54489f974213de71a47200d0c5ce1c04d8101
Jul 06 20:31:01.112629 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:01.112593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9" event={"ID":"05603ad7-9c84-4e48-b3d9-06cceb92d13e","Type":"ContainerStarted","Data":"6729478bd794f461f60d3a8114e54489f974213de71a47200d0c5ce1c04d8101"}
Jul 06 20:31:02.467823 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.467778    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:31:02.468129 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.467871    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:31:02.868581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.868551    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"]
Jul 06 20:31:02.872434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.872410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:02.876491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.876466    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 20:31:02.876636 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.876493    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pxhqz\""
Jul 06 20:31:02.909770 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.909727    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"]
Jul 06 20:31:02.911715 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.911683    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"]
Jul 06 20:31:02.918401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.918342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:02.923498 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.923466    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pz26z\""
Jul 06 20:31:02.929637 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.929601    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 20:31:02.947602 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.947567    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"]
Jul 06 20:31:02.973221 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.973183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:02.973435 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:02.973329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hljs\" (UniqueName: \"kubernetes.io/projected/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-kube-api-access-6hljs\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.074638 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.074597    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hljs\" (UniqueName: \"kubernetes.io/projected/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-kube-api-access-6hljs\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.074852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.074658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w945b\" (UniqueName: \"kubernetes.io/projected/cabe8f1a-db88-4f81-8d90-c5374e372688-kube-api-access-w945b\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.074852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.074687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.074852 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:31:03.074769    2571 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 20:31:03.074852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.074795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabe8f1a-db88-4f81-8d90-c5374e372688-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.074852 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:31:03.074824    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert podName:3d4e80b1-1719-4653-8eaa-6ae3a6b54a62 nodeName:}" failed. No retries permitted until 2026-07-06 20:31:03.574800378 +0000 UTC m=+426.010453533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert") pod "kserve-controller-manager-d6f4b65b8-ht86g" (UID: "3d4e80b1-1719-4653-8eaa-6ae3a6b54a62") : secret "kserve-webhook-server-cert" not found
Jul 06 20:31:03.086899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.086862    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hljs\" (UniqueName: \"kubernetes.io/projected/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-kube-api-access-6hljs\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.125212 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.125110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9" event={"ID":"05603ad7-9c84-4e48-b3d9-06cceb92d13e","Type":"ContainerStarted","Data":"1b827a8de28f524f37e85c854daf50bff5be3347e6034e5b91fe3fdafb017433"}
Jul 06 20:31:03.125212 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.125173    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:03.127066 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.127038    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-5vvx9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:31:03.127183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.127084    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9" podUID="05603ad7-9c84-4e48-b3d9-06cceb92d13e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:31:03.168788 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.168731    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9" podStartSLOduration=2.039144756 podStartE2EDuration="4.168713962s" totalImagesPullingTime="2.129569206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:03.167164457 +0000 UTC m=+425.602817672" watchObservedRunningTime="2026-07-06 20:31:03.168713962 +0000 UTC m=+425.604367138"
Jul 06 20:31:03.176070 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.176037    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w945b\" (UniqueName: \"kubernetes.io/projected/cabe8f1a-db88-4f81-8d90-c5374e372688-kube-api-access-w945b\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.176172 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.176118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabe8f1a-db88-4f81-8d90-c5374e372688-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.178671 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.178647    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabe8f1a-db88-4f81-8d90-c5374e372688-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.201551 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.201515    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w945b\" (UniqueName: \"kubernetes.io/projected/cabe8f1a-db88-4f81-8d90-c5374e372688-kube-api-access-w945b\") pod \"llmisvc-controller-manager-777c6bd7d5-jc4gj\" (UID: \"cabe8f1a-db88-4f81-8d90-c5374e372688\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.230937 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.230900    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:03.437767 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.437739    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"]
Jul 06 20:31:03.439301 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:31:03.439273    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcabe8f1a_db88_4f81_8d90_c5374e372688.slice/crio-afc05735c0e6c625b63422b21ee76b1d26453b9deb4b99bea12def90fcbfb0df WatchSource:0}: Error finding container afc05735c0e6c625b63422b21ee76b1d26453b9deb4b99bea12def90fcbfb0df: Status 404 returned error can't find the container with id afc05735c0e6c625b63422b21ee76b1d26453b9deb4b99bea12def90fcbfb0df
Jul 06 20:31:03.579947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.579903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.582648 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.582612    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4e80b1-1719-4653-8eaa-6ae3a6b54a62-cert\") pod \"kserve-controller-manager-d6f4b65b8-ht86g\" (UID: \"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.784569 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.784488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:03.977757 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:03.977729    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"]
Jul 06 20:31:03.980165 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:31:03.980133    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4e80b1_1719_4653_8eaa_6ae3a6b54a62.slice/crio-82af14989ee1fcef37bbc00bc9ecb7f6f2d01cf52cfeb858c219e58921943708 WatchSource:0}: Error finding container 82af14989ee1fcef37bbc00bc9ecb7f6f2d01cf52cfeb858c219e58921943708: Status 404 returned error can't find the container with id 82af14989ee1fcef37bbc00bc9ecb7f6f2d01cf52cfeb858c219e58921943708
Jul 06 20:31:04.132812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:04.132747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj" event={"ID":"cabe8f1a-db88-4f81-8d90-c5374e372688","Type":"ContainerStarted","Data":"afc05735c0e6c625b63422b21ee76b1d26453b9deb4b99bea12def90fcbfb0df"}
Jul 06 20:31:04.134201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:04.134172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g" event={"ID":"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62","Type":"ContainerStarted","Data":"82af14989ee1fcef37bbc00bc9ecb7f6f2d01cf52cfeb858c219e58921943708"}
Jul 06 20:31:04.135057 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:04.135031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5vvx9"
Jul 06 20:31:05.754314 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:05.754259    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:31:05.754744 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:05.754381    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:31:05.754744 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:05.754437    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:31:07.156255 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.156223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t" event={"ID":"24203ffa-c913-4942-9e1d-7467025ffd90","Type":"ContainerStarted","Data":"5ef0010b92bfcbc8674df8122594e3fff4038f8ff6ddf302049d231241702cfd"}
Jul 06 20:31:07.157854 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.157830    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj" event={"ID":"cabe8f1a-db88-4f81-8d90-c5374e372688","Type":"ContainerStarted","Data":"cd8553cd888ddf5c2364ea19e5cc1a1aeaba916b86512a22078563a937a97b8d"}
Jul 06 20:31:07.157983 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.157913    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:07.184686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.184633    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t" podStartSLOduration=2.839869802 podStartE2EDuration="11.184614867s" totalImagesPullingTime="8.344745065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:07.183717596 +0000 UTC m=+429.619370773" watchObservedRunningTime="2026-07-06 20:31:07.184614867 +0000 UTC m=+429.620268044"
Jul 06 20:31:07.238075 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.238005    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj" podStartSLOduration=2.030810464 podStartE2EDuration="5.237980977s" totalImagesPullingTime="3.207170513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:07.233464813 +0000 UTC m=+429.669117991" watchObservedRunningTime="2026-07-06 20:31:07.237980977 +0000 UTC m=+429.673634155"
Jul 06 20:31:07.253136 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.253101    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:31:07.258900 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:07.258869    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:31:08.097464 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.097350    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-r65z8"
Jul 06 20:31:08.099563 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.099536    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-p4pj5"
Jul 06 20:31:08.166461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.166423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g" event={"ID":"3d4e80b1-1719-4653-8eaa-6ae3a6b54a62","Type":"ContainerStarted","Data":"b9ff255a03ef2c0905e197cde89c14835e85e6431d6c3eea4993da5409363803"}
Jul 06 20:31:08.167485 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.167464    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:31:08.167624 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.167507    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:31:08.168434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.168412    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4pvc7t"
Jul 06 20:31:08.197960 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:08.197900    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g" podStartSLOduration=2.38839629 podStartE2EDuration="6.197881893s" totalImagesPullingTime="3.809485603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:08.196753987 +0000 UTC m=+430.632407165" watchObservedRunningTime="2026-07-06 20:31:08.197881893 +0000 UTC m=+430.633535070"
Jul 06 20:31:38.171183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:38.171151    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jc4gj"
Jul 06 20:31:39.177616 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:31:39.177579    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ht86g"
Jul 06 20:32:06.856171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.856138    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"]
Jul 06 20:32:06.859204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.859185    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.862759 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.862732    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 20:32:06.862934 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.862778    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 20:32:06.862934 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.862794    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c8bz4\""
Jul 06 20:32:06.869151 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.869116    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.869293 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.869178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.869293 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.869207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqpxj\" (UniqueName: \"kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.870282 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.870259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"]
Jul 06 20:32:06.969964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.969921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.970218 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.969976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.970218 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.969994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqpxj\" (UniqueName: \"kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.970446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.970421    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.970524 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.970449    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:06.984076 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:06.984050    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqpxj\" (UniqueName: \"kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:07.169274 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.169239    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:07.322562 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.322527    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"]
Jul 06 20:32:07.326033 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:07.326007    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0eea0a3_184e_43b3_ab67_7ac81aaf9d10.slice/crio-24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf WatchSource:0}: Error finding container 24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf: Status 404 returned error can't find the container with id 24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf
Jul 06 20:32:07.470621 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.470588    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerID="6478ad4ca3dd6d0941b94cf2987bce1c9b79ab6872c19e8a028cd62e308c5676" exitCode=0
Jul 06 20:32:07.470785 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.470646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns" event={"ID":"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10","Type":"ContainerDied","Data":"6478ad4ca3dd6d0941b94cf2987bce1c9b79ab6872c19e8a028cd62e308c5676"}
Jul 06 20:32:07.470785 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.470681    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns" event={"ID":"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10","Type":"ContainerStarted","Data":"24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf"}
Jul 06 20:32:07.484581 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.484546    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"]
Jul 06 20:32:07.487546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.487526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.502491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.502463    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"]
Jul 06 20:32:07.575513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.575469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.575675 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.575528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftv4m\" (UniqueName: \"kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.575760 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.575667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.676773 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.676725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.676957 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.676797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.676957 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.676832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftv4m\" (UniqueName: \"kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.677163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.677146    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.677218 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.677203    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.687094 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.687021    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftv4m\" (UniqueName: \"kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.809709 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.809674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:07.984959 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:07.984824    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"]
Jul 06 20:32:07.988367 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:07.988317    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d6599f_1a69_4640_b2b4_322dc77c0e5c.slice/crio-3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161 WatchSource:0}: Error finding container 3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161: Status 404 returned error can't find the container with id 3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161
Jul 06 20:32:08.265276 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.265189    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"]
Jul 06 20:32:08.267972 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.267953    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.279533 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.279505    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"]
Jul 06 20:32:08.282329 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.282299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnxjz\" (UniqueName: \"kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.282486 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.282339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.282486 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.282436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.383066 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.383032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnxjz\" (UniqueName: \"kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.383066 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.383075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.383313 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.383114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.383565 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.383542    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.383653 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.383571    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.391695 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.391663    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnxjz\" (UniqueName: \"kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.476862 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.476823    2571 generic.go:356] "Generic (PLEG): container finished" podID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerID="e0ee3c0c1dc1700c9c5d288c3a3faf9774d9eb84a3197705a58a35a06354d7af" exitCode=0
Jul 06 20:32:08.477001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.476899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm" event={"ID":"08d6599f-1a69-4640-b2b4-322dc77c0e5c","Type":"ContainerDied","Data":"e0ee3c0c1dc1700c9c5d288c3a3faf9774d9eb84a3197705a58a35a06354d7af"}
Jul 06 20:32:08.477001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.476952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm" event={"ID":"08d6599f-1a69-4640-b2b4-322dc77c0e5c","Type":"ContainerStarted","Data":"3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161"}
Jul 06 20:32:08.478787 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.478760    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerID="c162c56a0a8fbf04c94dda6532f97bfc131e4940ddee26e45e83984b9bc06ad1" exitCode=0
Jul 06 20:32:08.478926 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.478815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns" event={"ID":"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10","Type":"ContainerDied","Data":"c162c56a0a8fbf04c94dda6532f97bfc131e4940ddee26e45e83984b9bc06ad1"}
Jul 06 20:32:08.578198 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.578167    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:08.734282 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:08.734250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"]
Jul 06 20:32:08.735451 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:08.735421    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5377c69_d04a_40fc_9622_73a402e22532.slice/crio-e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b WatchSource:0}: Error finding container e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b: Status 404 returned error can't find the container with id e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b
Jul 06 20:32:09.076031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.075990    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"]
Jul 06 20:32:09.079614 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.079592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.089366 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.089320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.089522 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.089413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnm7m\" (UniqueName: \"kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.089582 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.089517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.097434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.097403    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"]
Jul 06 20:32:09.189954 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.189918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.190149 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.189995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.190149 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.190029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnm7m\" (UniqueName: \"kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.190329 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.190310    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.190388 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.190334    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.199436 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.199400    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnm7m\" (UniqueName: \"kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.415686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.415648    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:09.487845 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.487810    2571 generic.go:356] "Generic (PLEG): container finished" podID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerID="a1ee6a8a75735ee21d66425230fd70d29f4fdd5396aa2d9bfdbf9f4eefcffbbb" exitCode=0
Jul 06 20:32:09.488033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.487859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm" event={"ID":"08d6599f-1a69-4640-b2b4-322dc77c0e5c","Type":"ContainerDied","Data":"a1ee6a8a75735ee21d66425230fd70d29f4fdd5396aa2d9bfdbf9f4eefcffbbb"}
Jul 06 20:32:09.489704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.489556    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5377c69-d04a-40fc-9622-73a402e22532" containerID="169bb5be872cc8995960ce9add4342bdcfba5a3874e2d29c1f29f94c000b9a13" exitCode=0
Jul 06 20:32:09.489704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.489595    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm" event={"ID":"f5377c69-d04a-40fc-9622-73a402e22532","Type":"ContainerDied","Data":"169bb5be872cc8995960ce9add4342bdcfba5a3874e2d29c1f29f94c000b9a13"}
Jul 06 20:32:09.489704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.489643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm" event={"ID":"f5377c69-d04a-40fc-9622-73a402e22532","Type":"ContainerStarted","Data":"e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b"}
Jul 06 20:32:09.492178 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.492155    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerID="f84828ebb7a40a607118ea2bc5c7fc247d93a57b2eeb0b0a6fc8c959b28f8b81" exitCode=0
Jul 06 20:32:09.492297 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.492190    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns" event={"ID":"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10","Type":"ContainerDied","Data":"f84828ebb7a40a607118ea2bc5c7fc247d93a57b2eeb0b0a6fc8c959b28f8b81"}
Jul 06 20:32:09.570037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:09.570010    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"]
Jul 06 20:32:09.572193 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:09.572164    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80504171_1986_45e6_a1a4_add97713a98c.slice/crio-8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a WatchSource:0}: Error finding container 8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a: Status 404 returned error can't find the container with id 8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a
Jul 06 20:32:10.499751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.499710    2571 generic.go:356] "Generic (PLEG): container finished" podID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerID="f7d04aad14db4b120b14e696e2a315f346a1f639ff468661769011495303cf45" exitCode=0
Jul 06 20:32:10.500172 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.499809    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm" event={"ID":"08d6599f-1a69-4640-b2b4-322dc77c0e5c","Type":"ContainerDied","Data":"f7d04aad14db4b120b14e696e2a315f346a1f639ff468661769011495303cf45"}
Jul 06 20:32:10.501703 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.501677    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5377c69-d04a-40fc-9622-73a402e22532" containerID="f2bf0f25bf3d386381cdd2eaba6ad198088b4d3c2203dc779e9c4a51633b24e3" exitCode=0
Jul 06 20:32:10.501835 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.501747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm" event={"ID":"f5377c69-d04a-40fc-9622-73a402e22532","Type":"ContainerDied","Data":"f2bf0f25bf3d386381cdd2eaba6ad198088b4d3c2203dc779e9c4a51633b24e3"}
Jul 06 20:32:10.503307 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.503283    2571 generic.go:356] "Generic (PLEG): container finished" podID="80504171-1986-45e6-a1a4-add97713a98c" containerID="94483afce55a901a5f17f30957963e62700e01ad8db4a515ec8c37cfa36060b7" exitCode=0
Jul 06 20:32:10.503503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.503346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7" event={"ID":"80504171-1986-45e6-a1a4-add97713a98c","Type":"ContainerDied","Data":"94483afce55a901a5f17f30957963e62700e01ad8db4a515ec8c37cfa36060b7"}
Jul 06 20:32:10.503503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.503409    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7" event={"ID":"80504171-1986-45e6-a1a4-add97713a98c","Type":"ContainerStarted","Data":"8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a"}
Jul 06 20:32:10.650309 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.650280    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:10.702481 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.702445    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqpxj\" (UniqueName: \"kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj\") pod \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") "
Jul 06 20:32:10.702700 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.702595    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util\") pod \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") "
Jul 06 20:32:10.702700 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.702663    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle\") pod \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\" (UID: \"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10\") "
Jul 06 20:32:10.703161 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.703121    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle" (OuterVolumeSpecName: "bundle") pod "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" (UID: "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:10.704782 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.704750    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj" (OuterVolumeSpecName: "kube-api-access-dqpxj") pod "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" (UID: "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10"). InnerVolumeSpecName "kube-api-access-dqpxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:10.708472 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.708447    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util" (OuterVolumeSpecName: "util") pod "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" (UID: "a0eea0a3-184e-43b3-ab67-7ac81aaf9d10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:10.803811 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.803707    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:10.803811 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.803754    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:10.803811 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:10.803764    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqpxj\" (UniqueName: \"kubernetes.io/projected/a0eea0a3-184e-43b3-ab67-7ac81aaf9d10-kube-api-access-dqpxj\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:11.511130 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.511037    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5377c69-d04a-40fc-9622-73a402e22532" containerID="f48d37bc1161da657734d1db446f68cdc8fec78b41437d9c1b4dbfaed69bdfb3" exitCode=0
Jul 06 20:32:11.511560 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.511121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm" event={"ID":"f5377c69-d04a-40fc-9622-73a402e22532","Type":"ContainerDied","Data":"f48d37bc1161da657734d1db446f68cdc8fec78b41437d9c1b4dbfaed69bdfb3"}
Jul 06 20:32:11.512965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.512940    2571 generic.go:356] "Generic (PLEG): container finished" podID="80504171-1986-45e6-a1a4-add97713a98c" containerID="68ee0b28ac85700270d9812a416c282b7dc613ecdd180f068ba9beac5325ff86" exitCode=0
Jul 06 20:32:11.513084 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.513021    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7" event={"ID":"80504171-1986-45e6-a1a4-add97713a98c","Type":"ContainerDied","Data":"68ee0b28ac85700270d9812a416c282b7dc613ecdd180f068ba9beac5325ff86"}
Jul 06 20:32:11.514938 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.514916    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns" event={"ID":"a0eea0a3-184e-43b3-ab67-7ac81aaf9d10","Type":"ContainerDied","Data":"24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf"}
Jul 06 20:32:11.514938 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.514931    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns"
Jul 06 20:32:11.515033 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.514963    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24ad2dcec75712b32fec7fc83c9ff0c2621f288dc17dc2ab7cefe8b8a9c87acf"
Jul 06 20:32:11.660278 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.659950    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:11.711544 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.711499    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util\") pod \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") "
Jul 06 20:32:11.711544 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.711544    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle\") pod \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") "
Jul 06 20:32:11.711763 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.711614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftv4m\" (UniqueName: \"kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m\") pod \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\" (UID: \"08d6599f-1a69-4640-b2b4-322dc77c0e5c\") "
Jul 06 20:32:11.712147 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.712116    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle" (OuterVolumeSpecName: "bundle") pod "08d6599f-1a69-4640-b2b4-322dc77c0e5c" (UID: "08d6599f-1a69-4640-b2b4-322dc77c0e5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:11.713944 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.713910    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m" (OuterVolumeSpecName: "kube-api-access-ftv4m") pod "08d6599f-1a69-4640-b2b4-322dc77c0e5c" (UID: "08d6599f-1a69-4640-b2b4-322dc77c0e5c"). InnerVolumeSpecName "kube-api-access-ftv4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:11.716950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.716920    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util" (OuterVolumeSpecName: "util") pod "08d6599f-1a69-4640-b2b4-322dc77c0e5c" (UID: "08d6599f-1a69-4640-b2b4-322dc77c0e5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:11.813156 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.813063    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftv4m\" (UniqueName: \"kubernetes.io/projected/08d6599f-1a69-4640-b2b4-322dc77c0e5c-kube-api-access-ftv4m\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:11.813156 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.813095    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:11.813156 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:11.813106    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08d6599f-1a69-4640-b2b4-322dc77c0e5c-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:12.522704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.522614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm" event={"ID":"08d6599f-1a69-4640-b2b4-322dc77c0e5c","Type":"ContainerDied","Data":"3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161"}
Jul 06 20:32:12.522704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.522660    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3835979cbd5ddd7aefd546c3d245467704ce3231ffb5e98514b71cb629424161"
Jul 06 20:32:12.522704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.522619    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm"
Jul 06 20:32:12.524891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.524859    2571 generic.go:356] "Generic (PLEG): container finished" podID="80504171-1986-45e6-a1a4-add97713a98c" containerID="9ff72f1475e8f7897b88241d12e81a552d5d5241b4b4f86332f41eb29b34fb12" exitCode=0
Jul 06 20:32:12.525023 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.524972    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7" event={"ID":"80504171-1986-45e6-a1a4-add97713a98c","Type":"ContainerDied","Data":"9ff72f1475e8f7897b88241d12e81a552d5d5241b4b4f86332f41eb29b34fb12"}
Jul 06 20:32:12.661518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.661494    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:12.720632 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.720587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util\") pod \"f5377c69-d04a-40fc-9622-73a402e22532\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") "
Jul 06 20:32:12.720632 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.720639    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle\") pod \"f5377c69-d04a-40fc-9622-73a402e22532\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") "
Jul 06 20:32:12.720847 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.720666    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnxjz\" (UniqueName: \"kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz\") pod \"f5377c69-d04a-40fc-9622-73a402e22532\" (UID: \"f5377c69-d04a-40fc-9622-73a402e22532\") "
Jul 06 20:32:12.721145 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.721105    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle" (OuterVolumeSpecName: "bundle") pod "f5377c69-d04a-40fc-9622-73a402e22532" (UID: "f5377c69-d04a-40fc-9622-73a402e22532"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:12.722929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.722900    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz" (OuterVolumeSpecName: "kube-api-access-mnxjz") pod "f5377c69-d04a-40fc-9622-73a402e22532" (UID: "f5377c69-d04a-40fc-9622-73a402e22532"). InnerVolumeSpecName "kube-api-access-mnxjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:12.726058 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.726030    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util" (OuterVolumeSpecName: "util") pod "f5377c69-d04a-40fc-9622-73a402e22532" (UID: "f5377c69-d04a-40fc-9622-73a402e22532"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:12.821491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.821402    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:12.821491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.821460    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5377c69-d04a-40fc-9622-73a402e22532-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:12.821491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:12.821474    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnxjz\" (UniqueName: \"kubernetes.io/projected/f5377c69-d04a-40fc-9622-73a402e22532-kube-api-access-mnxjz\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:13.531597 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.531569    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm"
Jul 06 20:32:13.531973 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.531601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm" event={"ID":"f5377c69-d04a-40fc-9622-73a402e22532","Type":"ContainerDied","Data":"e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b"}
Jul 06 20:32:13.531973 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.531641    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e06fdae73ed96c65325af8c2d47802be5bc4f67078ac9ce84f110a5af821ba5b"
Jul 06 20:32:13.665797 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.665766    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:13.728454 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.728422    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util\") pod \"80504171-1986-45e6-a1a4-add97713a98c\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") "
Jul 06 20:32:13.728633 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.728491    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle\") pod \"80504171-1986-45e6-a1a4-add97713a98c\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") "
Jul 06 20:32:13.728633 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.728521    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnm7m\" (UniqueName: \"kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m\") pod \"80504171-1986-45e6-a1a4-add97713a98c\" (UID: \"80504171-1986-45e6-a1a4-add97713a98c\") "
Jul 06 20:32:13.729030 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.729005    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle" (OuterVolumeSpecName: "bundle") pod "80504171-1986-45e6-a1a4-add97713a98c" (UID: "80504171-1986-45e6-a1a4-add97713a98c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:13.730737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.730711    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m" (OuterVolumeSpecName: "kube-api-access-gnm7m") pod "80504171-1986-45e6-a1a4-add97713a98c" (UID: "80504171-1986-45e6-a1a4-add97713a98c"). InnerVolumeSpecName "kube-api-access-gnm7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:13.735045 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.734996    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util" (OuterVolumeSpecName: "util") pod "80504171-1986-45e6-a1a4-add97713a98c" (UID: "80504171-1986-45e6-a1a4-add97713a98c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:13.830188 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.830099    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-util\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:13.830188 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.830132    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80504171-1986-45e6-a1a4-add97713a98c-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:13.830188 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:13.830141    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnm7m\" (UniqueName: \"kubernetes.io/projected/80504171-1986-45e6-a1a4-add97713a98c-kube-api-access-gnm7m\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:14.539080 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:14.539003    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7"
Jul 06 20:32:14.539462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:14.539002    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7" event={"ID":"80504171-1986-45e6-a1a4-add97713a98c","Type":"ContainerDied","Data":"8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a"}
Jul 06 20:32:14.539462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:14.539140    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8304bb36dfe979af4bb3912990952e37d30bbef0539e063575e9853a42b5162a"
Jul 06 20:32:31.248979 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:31.248944    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:32:35.775427 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775386    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"]
Jul 06 20:32:35.775809 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775799    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="util"
Jul 06 20:32:35.775851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775815    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="util"
Jul 06 20:32:35.775851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775831    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="util"
Jul 06 20:32:35.775851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775840    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="util"
Jul 06 20:32:35.775851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775850    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775855    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775863    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775870    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775875    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775880    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775895    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775903    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="pull"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775912    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775919    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775932    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="util"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775940    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="util"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775949    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775959    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775971    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775979    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="extract"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775986    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="util"
Jul 06 20:32:35.775996 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.775993    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="util"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776003    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="extract"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776011    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="extract"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776110    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="08d6599f-1a69-4640-b2b4-322dc77c0e5c" containerName="extract"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776119    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="80504171-1986-45e6-a1a4-add97713a98c" containerName="extract"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776130    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5377c69-d04a-40fc-9622-73a402e22532" containerName="extract"
Jul 06 20:32:35.776555 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.776141    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0eea0a3-184e-43b3-ab67-7ac81aaf9d10" containerName="extract"
Jul 06 20:32:35.779141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.779117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:35.782678 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.782659    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9klrb\""
Jul 06 20:32:35.782799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.782677    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 20:32:35.783605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.783583    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 20:32:35.793723 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.793694    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"]
Jul 06 20:32:35.931257 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:35.931219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qtn6\" (UniqueName: \"kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6\") pod \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" (UID: \"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:36.032845 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:36.032733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qtn6\" (UniqueName: \"kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6\") pod \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" (UID: \"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:36.046675 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:36.046636    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qtn6\" (UniqueName: \"kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6\") pod \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" (UID: \"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:36.090446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:36.090405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:36.247639 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:36.247613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"]
Jul 06 20:32:36.249842 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:36.249817    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ea8a8c_417e_4b5f_a2b3_681fa2167d54.slice/crio-acba0a348c2677169840d2ca56a96c059d6a4d8837fc18aebe33d1692080c1ed WatchSource:0}: Error finding container acba0a348c2677169840d2ca56a96c059d6a4d8837fc18aebe33d1692080c1ed: Status 404 returned error can't find the container with id acba0a348c2677169840d2ca56a96c059d6a4d8837fc18aebe33d1692080c1ed
Jul 06 20:32:36.661184 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:36.661142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm" event={"ID":"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54","Type":"ContainerStarted","Data":"acba0a348c2677169840d2ca56a96c059d6a4d8837fc18aebe33d1692080c1ed"}
Jul 06 20:32:37.346669 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:37.346571    2571 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a8ddd8680c786d41e1c5ec282389f15f82b421a35e61634031c9c9243166cb5e: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/limitador-operator:v0.17.1"
Jul 06 20:32:37.347038 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:37.346710    2571 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod limitador-operator-controller-manager-859d7b78bd-sc5qm_kuadrant-system(c3ea8a8c-417e-4b5f-a2b3-681fa2167d54): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a8ddd8680c786d41e1c5ec282389f15f82b421a35e61634031c9c9243166cb5e: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 06 20:32:37.347038 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:37.346744    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a8ddd8680c786d41e1c5ec282389f15f82b421a35e61634031c9c9243166cb5e: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54"
Jul 06 20:32:37.668705 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:37.668674    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/limitador-operator:v0.17.1\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:a8ddd8680c786d41e1c5ec282389f15f82b421a35e61634031c9c9243166cb5e: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54"
Jul 06 20:32:48.328980 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.328938    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"]
Jul 06 20:32:48.342063 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.342010    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"]
Jul 06 20:32:48.345061 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:48.345010    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/kuadrant/limitador-operator:v0.17.1\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8qtn6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-sc5qm\": pods \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.354311 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.354250    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"]
Jul 06 20:32:48.357181 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.357162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:48.382874 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.382837    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"]
Jul 06 20:32:48.402469 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:48.402084    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" is forbidden: User \"system:node:ip-10-0-138-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-229.ec2.internal' and this object" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.485160 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.484851    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.487501 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:48.487451    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" is forbidden: User \"system:node:ip-10-0-138-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-229.ec2.internal' and this object" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.550695 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.550659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwg86\" (UniqueName: \"kubernetes.io/projected/32dbb76c-b195-4832-a078-3fee234b01a5-kube-api-access-kwg86\") pod \"limitador-operator-controller-manager-859d7b78bd-j29n9\" (UID: \"32dbb76c-b195-4832-a078-3fee234b01a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:48.651891 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.651845    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qtn6\" (UniqueName: \"kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6\") pod \"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\" (UID: \"c3ea8a8c-417e-4b5f-a2b3-681fa2167d54\") "
Jul 06 20:32:48.652102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.652014    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwg86\" (UniqueName: \"kubernetes.io/projected/32dbb76c-b195-4832-a078-3fee234b01a5-kube-api-access-kwg86\") pod \"limitador-operator-controller-manager-859d7b78bd-j29n9\" (UID: \"32dbb76c-b195-4832-a078-3fee234b01a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:48.654156 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.654117    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6" (OuterVolumeSpecName: "kube-api-access-8qtn6") pod "c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" (UID: "c3ea8a8c-417e-4b5f-a2b3-681fa2167d54"). InnerVolumeSpecName "kube-api-access-8qtn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:48.661874 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.661841    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwg86\" (UniqueName: \"kubernetes.io/projected/32dbb76c-b195-4832-a078-3fee234b01a5-kube-api-access-kwg86\") pod \"limitador-operator-controller-manager-859d7b78bd-j29n9\" (UID: \"32dbb76c-b195-4832-a078-3fee234b01a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:48.673422 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.673385    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:48.726846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.726712    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.729126 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:48.729065    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" is forbidden: User \"system:node:ip-10-0-138-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-229.ec2.internal' and this object" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.744148 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:48.744110    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sc5qm\" is forbidden: User \"system:node:ip-10-0-138-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-229.ec2.internal' and this object" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sc5qm"
Jul 06 20:32:48.753618 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.753586    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qtn6\" (UniqueName: \"kubernetes.io/projected/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54-kube-api-access-8qtn6\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:48.821727 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:48.821698    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"]
Jul 06 20:32:48.824539 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:32:48.824511    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dbb76c_b195_4832_a078_3fee234b01a5.slice/crio-56372b7bace2eb9d94e6e14bb32b6b8f2fa7233df0237556d0691c594b8df9fe WatchSource:0}: Error finding container 56372b7bace2eb9d94e6e14bb32b6b8f2fa7233df0237556d0691c594b8df9fe: Status 404 returned error can't find the container with id 56372b7bace2eb9d94e6e14bb32b6b8f2fa7233df0237556d0691c594b8df9fe
Jul 06 20:32:49.735863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:49.735751    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9" event={"ID":"32dbb76c-b195-4832-a078-3fee234b01a5","Type":"ContainerStarted","Data":"56372b7bace2eb9d94e6e14bb32b6b8f2fa7233df0237556d0691c594b8df9fe"}
Jul 06 20:32:50.175881 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:50.175839    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ea8a8c-417e-4b5f-a2b3-681fa2167d54" path="/var/lib/kubelet/pods/c3ea8a8c-417e-4b5f-a2b3-681fa2167d54/volumes"
Jul 06 20:32:51.748192 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:51.748138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9" event={"ID":"32dbb76c-b195-4832-a078-3fee234b01a5","Type":"ContainerStarted","Data":"4f5b5d90cb144672d6c801f06bd15ff886b6c52acf6ed3b182719238adc42b2c"}
Jul 06 20:32:51.748639 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:51.748226    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:32:51.771125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:51.771072    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9" podStartSLOduration=1.8154876070000001 podStartE2EDuration="3.771051578s" totalImagesPullingTime="1.955563971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:32:51.769794798 +0000 UTC m=+534.205447978" watchObservedRunningTime="2026-07-06 20:32:51.771051578 +0000 UTC m=+534.206704755"
Jul 06 20:32:56.270594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.270542    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-564c65db47-9kzcr" podUID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" containerName="console" containerID="cri-o://917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a" gracePeriod=15
Jul 06 20:32:56.530982 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.530909    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:32:56.624692 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624692 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624704    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqkhh\" (UniqueName: \"kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624956 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624723    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624956 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624746    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624956 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624793    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624956 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624840    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.624956 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.624882    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config\") pod \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\" (UID: \"a8e3832e-cf41-4a74-b162-a3e2c77018b2\") "
Jul 06 20:32:56.625379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.625236    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:32:56.625491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.625246    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:32:56.625491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.625397    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:32:56.625491 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.625445    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config" (OuterVolumeSpecName: "console-config") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:32:56.627008 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.626978    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:56.627008 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.626999    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:56.627131 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.627027    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh" (OuterVolumeSpecName: "kube-api-access-fqkhh") pod "a8e3832e-cf41-4a74-b162-a3e2c77018b2" (UID: "a8e3832e-cf41-4a74-b162-a3e2c77018b2"). InnerVolumeSpecName "kube-api-access-fqkhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:56.726388 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726319    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-service-ca\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726388 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726381    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-trusted-ca-bundle\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726388 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726393    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726624 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726402    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-oauth-config\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726624 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726412    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqkhh\" (UniqueName: \"kubernetes.io/projected/a8e3832e-cf41-4a74-b162-a3e2c77018b2-kube-api-access-fqkhh\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726624 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726421    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8e3832e-cf41-4a74-b162-a3e2c77018b2-console-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.726624 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.726430    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8e3832e-cf41-4a74-b162-a3e2c77018b2-oauth-serving-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:32:56.778606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.778571    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" containerID="917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a" exitCode=0
Jul 06 20:32:56.778775 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.778614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c65db47-9kzcr" event={"ID":"a8e3832e-cf41-4a74-b162-a3e2c77018b2","Type":"ContainerDied","Data":"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"}
Jul 06 20:32:56.778775 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.778617    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c65db47-9kzcr"
Jul 06 20:32:56.778775 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.778651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c65db47-9kzcr" event={"ID":"a8e3832e-cf41-4a74-b162-a3e2c77018b2","Type":"ContainerDied","Data":"77b0b4d722d2c93f1f2d5656d2bb1d39d9cf917e822df0a32e0e73c2d7a7f7b6"}
Jul 06 20:32:56.778775 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.778670    2571 scope.go:117] "RemoveContainer" containerID="917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"
Jul 06 20:32:56.788694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.788674    2571 scope.go:117] "RemoveContainer" containerID="917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"
Jul 06 20:32:56.789010 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:32:56.788994    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a\": container with ID starting with 917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a not found: ID does not exist" containerID="917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"
Jul 06 20:32:56.789061 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.789019    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a"} err="failed to get container status \"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a\": rpc error: code = NotFound desc = could not find container \"917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a\": container with ID starting with 917ee3e5feeaefb37f1a6a9884e448c52f62acae8860ead06df8c738c5d1ef3a not found: ID does not exist"
Jul 06 20:32:56.800200 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.800167    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:32:56.804558 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:56.804529    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564c65db47-9kzcr"]
Jul 06 20:32:58.175390 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:32:58.175334    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" path="/var/lib/kubelet/pods/a8e3832e-cf41-4a74-b162-a3e2c77018b2/volumes"
Jul 06 20:33:02.759662 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:02.759632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j29n9"
Jul 06 20:33:27.897212 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.897179    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"]
Jul 06 20:33:27.897701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.897601    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" containerName="console"
Jul 06 20:33:27.897701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.897613    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" containerName="console"
Jul 06 20:33:27.897794 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.897734    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e3832e-cf41-4a74-b162-a3e2c77018b2" containerName="console"
Jul 06 20:33:27.900312 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.900292    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:27.902968 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.902943    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7nncl\""
Jul 06 20:33:27.913641 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:27.913608    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"]
Jul 06 20:33:28.024513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024894 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024894 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024894 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b01aa22-48d8-4ace-949c-424cfe68830d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.024894 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgzkc\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-kube-api-access-mgzkc\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.025031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.024914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125713 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.125907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.125891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126244 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b01aa22-48d8-4ace-949c-424cfe68830d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126244 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgzkc\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-kube-api-access-mgzkc\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126244 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126179    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126244 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126221    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126450    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126483    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.126888 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.126866    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b01aa22-48d8-4ace-949c-424cfe68830d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.128639 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.128611    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.128756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.128723    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.133732 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.133696    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.133854 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.133803    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgzkc\" (UniqueName: \"kubernetes.io/projected/4b01aa22-48d8-4ace-949c-424cfe68830d-kube-api-access-mgzkc\") pod \"maas-default-gateway-openshift-default-56654dcf7-8gg55\" (UID: \"4b01aa22-48d8-4ace-949c-424cfe68830d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.211212 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.211117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:28.358798 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.358767    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"]
Jul 06 20:33:28.360251 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:33:28.360221    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b01aa22_48d8_4ace_949c_424cfe68830d.slice/crio-d1464ed6800cf1ca3fc5a39e2c28e6b75409c33461345dfbd33a0689fe45af65 WatchSource:0}: Error finding container d1464ed6800cf1ca3fc5a39e2c28e6b75409c33461345dfbd33a0689fe45af65: Status 404 returned error can't find the container with id d1464ed6800cf1ca3fc5a39e2c28e6b75409c33461345dfbd33a0689fe45af65
Jul 06 20:33:28.362499 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.362467    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:33:28.362582 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.362549    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:33:28.362620 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.362584    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:33:28.954879 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.954837    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" event={"ID":"4b01aa22-48d8-4ace-949c-424cfe68830d","Type":"ContainerStarted","Data":"7c5835d7e52ce1a9ae141e3787c071421b6f4810bcf4d1b62ca0484fefd6fa23"}
Jul 06 20:33:28.955314 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.954901    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" event={"ID":"4b01aa22-48d8-4ace-949c-424cfe68830d","Type":"ContainerStarted","Data":"d1464ed6800cf1ca3fc5a39e2c28e6b75409c33461345dfbd33a0689fe45af65"}
Jul 06 20:33:28.980136 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:28.980085    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" podStartSLOduration=1.980066623 podStartE2EDuration="1.980066623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:33:28.977785655 +0000 UTC m=+571.413438833" watchObservedRunningTime="2026-07-06 20:33:28.980066623 +0000 UTC m=+571.415719800"
Jul 06 20:33:29.212389 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:29.212282    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:29.217119 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:29.217094    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:29.960142 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:29.960108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:33:29.961309 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:33:29.961287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:34:53.418333 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.418296    2571 generic.go:356] "Generic (PLEG): container finished" podID="4b01aa22-48d8-4ace-949c-424cfe68830d" containerID="7c5835d7e52ce1a9ae141e3787c071421b6f4810bcf4d1b62ca0484fefd6fa23" exitCode=0
Jul 06 20:34:53.418796 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.418398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" event={"ID":"4b01aa22-48d8-4ace-949c-424cfe68830d","Type":"ContainerDied","Data":"7c5835d7e52ce1a9ae141e3787c071421b6f4810bcf4d1b62ca0484fefd6fa23"}
Jul 06 20:34:53.418796 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.418792    2571 scope.go:117] "RemoveContainer" containerID="7c5835d7e52ce1a9ae141e3787c071421b6f4810bcf4d1b62ca0484fefd6fa23"
Jul 06 20:34:53.419833 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.419798    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:34:53.419934 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.419900    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:34:53.419995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:53.419946    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:34:54.426249 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:54.426215    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" event={"ID":"4b01aa22-48d8-4ace-949c-424cfe68830d","Type":"ContainerStarted","Data":"b13de25bbf6203ad00b6eaf7c61098a5c74021c38dfd8a88c68964b5a497a1d2"}
Jul 06 20:34:55.212123 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:55.212085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:34:55.213392 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:55.213333    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8gg55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:34:55.213527 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:55.213419    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" podUID="4b01aa22-48d8-4ace-949c-424cfe68830d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:34:56.211799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:56.211764    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8gg55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:34:56.212194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:56.211833    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" podUID="4b01aa22-48d8-4ace-949c-424cfe68830d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:34:57.212429 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:57.212385    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8gg55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:34:57.212805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:57.212455    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" podUID="4b01aa22-48d8-4ace-949c-424cfe68830d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:34:58.211514 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:58.211478    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8gg55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:34:58.211703 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:58.211556    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55" podUID="4b01aa22-48d8-4ace-949c-424cfe68830d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:34:59.215813 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:59.215780    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:34:59.216279 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:59.216070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:34:59.216963 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:34:59.216946    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8gg55"
Jul 06 20:35:12.309110 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.309077    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"]
Jul 06 20:35:12.312930 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.312903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.315524 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.315497    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 20:35:12.315670 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.315528    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 20:35:12.317915 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.317894    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 20:35:12.318037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.317941    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6dg98\""
Jul 06 20:35:12.329153 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.329124    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"]
Jul 06 20:35:12.402625 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.402812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932f270a-c8b7-4a1a-aed5-31af7973194e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.402812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402711    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.402812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.402812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l86z4\" (UniqueName: \"kubernetes.io/projected/932f270a-c8b7-4a1a-aed5-31af7973194e-kube-api-access-l86z4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.402812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.402799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.503901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.503857    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932f270a-c8b7-4a1a-aed5-31af7973194e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.503901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.503903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.503928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.503947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l86z4\" (UniqueName: \"kubernetes.io/projected/932f270a-c8b7-4a1a-aed5-31af7973194e-kube-api-access-l86z4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.503980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.504036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.504405    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.504451    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.504535 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.504500    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.506232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.506202    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/932f270a-c8b7-4a1a-aed5-31af7973194e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.506541 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.506521    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/932f270a-c8b7-4a1a-aed5-31af7973194e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.512842 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.512815    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l86z4\" (UniqueName: \"kubernetes.io/projected/932f270a-c8b7-4a1a-aed5-31af7973194e-kube-api-access-l86z4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w5kh4\" (UID: \"932f270a-c8b7-4a1a-aed5-31af7973194e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.623864 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.623829    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:12.769461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.769437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"]
Jul 06 20:35:12.771990 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:35:12.771961    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932f270a_c8b7_4a1a_aed5_31af7973194e.slice/crio-6a4485577acbab5c0d8c585a06299f9e442d3393cfc9cdb7e4239f594979dcc1 WatchSource:0}: Error finding container 6a4485577acbab5c0d8c585a06299f9e442d3393cfc9cdb7e4239f594979dcc1: Status 404 returned error can't find the container with id 6a4485577acbab5c0d8c585a06299f9e442d3393cfc9cdb7e4239f594979dcc1
Jul 06 20:35:12.773319 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:12.773300    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:35:13.532150 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:13.532105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4" event={"ID":"932f270a-c8b7-4a1a-aed5-31af7973194e","Type":"ContainerStarted","Data":"6a4485577acbab5c0d8c585a06299f9e442d3393cfc9cdb7e4239f594979dcc1"}
Jul 06 20:35:14.539599 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:14.539560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4" event={"ID":"932f270a-c8b7-4a1a-aed5-31af7973194e","Type":"ContainerStarted","Data":"92b9d7c8db773e05403e2f6bcd985acd0d3bd11178445e3adcd6a93ef6da734c"}
Jul 06 20:35:14.557981 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:14.557914    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4" podStartSLOduration=1.552845746 podStartE2EDuration="2.55789528s" totalImagesPullingTime="1.005049534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:14.555646143 +0000 UTC m=+676.991299331" watchObservedRunningTime="2026-07-06 20:35:14.55789528 +0000 UTC m=+676.993548466"
Jul 06 20:35:22.624308 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:22.624270    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:22.624828 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:22.624349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:22.636810 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:22.636778    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:23.598725 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:23.598688    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w5kh4"
Jul 06 20:35:32.725965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.725916    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"]
Jul 06 20:35:32.729714 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.729690    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.732541 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.732519    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 20:35:32.740883 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.740855    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"]
Jul 06 20:35:32.899687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.899687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lqg\" (UniqueName: \"kubernetes.io/projected/9a9cd4c5-a73c-4e0c-a759-5232757ac707-kube-api-access-d6lqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.899919 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.899919 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.899919 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899858    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:32.899919 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:32.899887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001306 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001306 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001589 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001589 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lqg\" (UniqueName: \"kubernetes.io/projected/9a9cd4c5-a73c-4e0c-a759-5232757ac707-kube-api-access-d6lqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001589 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001589 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001773 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001696    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001773 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001721    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.001773 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.001746    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.003758 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.003722    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a9cd4c5-a73c-4e0c-a759-5232757ac707-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.003947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.003932    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a9cd4c5-a73c-4e0c-a759-5232757ac707-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.010173 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.010142    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lqg\" (UniqueName: \"kubernetes.io/projected/9a9cd4c5-a73c-4e0c-a759-5232757ac707-kube-api-access-d6lqg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2\" (UID: \"9a9cd4c5-a73c-4e0c-a759-5232757ac707\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.040608 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.040574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:33.182713 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.182682    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"]
Jul 06 20:35:33.183816 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:35:33.183794    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9cd4c5_a73c_4e0c_a759_5232757ac707.slice/crio-d4d1f6713a23cc719d60ddf75e1f7c801645f77598a4af358fdbba984ca75b31 WatchSource:0}: Error finding container d4d1f6713a23cc719d60ddf75e1f7c801645f77598a4af358fdbba984ca75b31: Status 404 returned error can't find the container with id d4d1f6713a23cc719d60ddf75e1f7c801645f77598a4af358fdbba984ca75b31
Jul 06 20:35:33.644106 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.644071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2" event={"ID":"9a9cd4c5-a73c-4e0c-a759-5232757ac707","Type":"ContainerStarted","Data":"883a9e8d873af427edfad7a81bda7d8a8749a5b3ca089977f568ba842301b09e"}
Jul 06 20:35:33.644292 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.644127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2" event={"ID":"9a9cd4c5-a73c-4e0c-a759-5232757ac707","Type":"ContainerStarted","Data":"d4d1f6713a23cc719d60ddf75e1f7c801645f77598a4af358fdbba984ca75b31"}
Jul 06 20:35:33.668502 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:33.668443    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2" podStartSLOduration=1.496963917 podStartE2EDuration="1.668427507s" totalImagesPullingTime="171.46359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:33.665641553 +0000 UTC m=+696.101294730" watchObservedRunningTime="2026-07-06 20:35:33.668427507 +0000 UTC m=+696.104080683"
Jul 06 20:35:43.041318 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:43.041282    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:43.041854 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:43.041339    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:43.054370 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:43.054327    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:35:43.711241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:35:43.711211    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2"
Jul 06 20:51:21.995243 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:21.995204    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:21.998810 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:21.998787    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.013674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.013646    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b01900e5-openshift-default-dockercfg-bpvxd\""
Jul 06 20:51:22.041878 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.041843    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:22.125561 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.125561 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125569    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.125846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.125846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.125846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.125846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlch2\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.126038 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.126038 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.126038 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.125947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227503 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlch2\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.227801 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228045 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227910    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228045 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.227922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228432 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.228402    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228432 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.228416    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.228483    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.228580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.228540    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.230272 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.230239    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.230396 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.230344    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.237832 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.237803    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.237983 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.237916    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlch2\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2\") pod \"e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") " pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.310841 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.310802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:22.465892 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.465863    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:22.468592 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:51:22.468560    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2fb433_ebf7_489f_badd_45acc2e193be.slice/crio-13269f4fc7efa792c9faa51c6ad91eb407fcf0eaa660b692b606f886cf2b8bb4 WatchSource:0}: Error finding container 13269f4fc7efa792c9faa51c6ad91eb407fcf0eaa660b692b606f886cf2b8bb4: Status 404 returned error can't find the container with id 13269f4fc7efa792c9faa51c6ad91eb407fcf0eaa660b692b606f886cf2b8bb4
Jul 06 20:51:22.471331 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.471300    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:22.471492 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.471419    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:22.471492 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.471465    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:22.931037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.931003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" event={"ID":"8b2fb433-ebf7-489f-badd-45acc2e193be","Type":"ContainerStarted","Data":"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"}
Jul 06 20:51:22.931233 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.931066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" event={"ID":"8b2fb433-ebf7-489f-badd-45acc2e193be","Type":"ContainerStarted","Data":"13269f4fc7efa792c9faa51c6ad91eb407fcf0eaa660b692b606f886cf2b8bb4"}
Jul 06 20:51:22.958114 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:22.958056    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" podStartSLOduration=1.958035859 podStartE2EDuration="1.958035859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:51:22.956332937 +0000 UTC m=+1645.391986136" watchObservedRunningTime="2026-07-06 20:51:22.958035859 +0000 UTC m=+1645.393689036"
Jul 06 20:51:23.311696 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:23.311595    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:23.317045 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:23.317014    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:23.937321 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:23.937287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:23.938466 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:23.938448    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:28.354444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:28.354402    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:28.354865 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:28.354641    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" podUID="8b2fb433-ebf7-489f-badd-45acc2e193be" containerName="istio-proxy" containerID="cri-o://5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c" gracePeriod=30
Jul 06 20:51:33.218385 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.218308    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:33.350300 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350256    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350316    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlch2\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350346    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350393    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350424    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350480    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350508 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350506    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350558    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350622    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket\") pod \"8b2fb433-ebf7-489f-badd-45acc2e193be\" (UID: \"8b2fb433-ebf7-489f-badd-45acc2e193be\") "
Jul 06 20:51:33.350812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350632    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:33.350972 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350832    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:33.351028 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.350992    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:51:33.351028 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.351006    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.351125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.351026    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.351249 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.351184    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:33.351488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.351457    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:33.352849 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.352818    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2" (OuterVolumeSpecName: "kube-api-access-vlch2") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "kube-api-access-vlch2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:51:33.352955 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.352869    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:51:33.353091 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.353070    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:51:33.353138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.353063    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b2fb433-ebf7-489f-badd-45acc2e193be" (UID: "8b2fb433-ebf7-489f-badd-45acc2e193be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:33.451594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451545    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlch2\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-kube-api-access-vlch2\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451579    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451590    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451599    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2fb433-ebf7-489f-badd-45acc2e193be-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451606    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451615    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:33.451901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:33.451622    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2fb433-ebf7-489f-badd-45acc2e193be-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:34.012588 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.012553    2571 generic.go:356] "Generic (PLEG): container finished" podID="8b2fb433-ebf7-489f-badd-45acc2e193be" containerID="5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c" exitCode=0
Jul 06 20:51:34.012799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.012611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" event={"ID":"8b2fb433-ebf7-489f-badd-45acc2e193be","Type":"ContainerDied","Data":"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"}
Jul 06 20:51:34.012799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.012627    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"
Jul 06 20:51:34.012799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.012689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml" event={"ID":"8b2fb433-ebf7-489f-badd-45acc2e193be","Type":"ContainerDied","Data":"13269f4fc7efa792c9faa51c6ad91eb407fcf0eaa660b692b606f886cf2b8bb4"}
Jul 06 20:51:34.012799 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.012718    2571 scope.go:117] "RemoveContainer" containerID="5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"
Jul 06 20:51:34.023313 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.023294    2571 scope.go:117] "RemoveContainer" containerID="5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"
Jul 06 20:51:34.023681 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:51:34.023659    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c\": container with ID starting with 5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c not found: ID does not exist" containerID="5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"
Jul 06 20:51:34.023782 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.023688    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c"} err="failed to get container status \"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c\": rpc error: code = NotFound desc = could not find container \"5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c\": container with ID starting with 5eff0c99a97f797507c95db06f8a2d8f29f349e3b4c8fc9fae15f9da7b84914c not found: ID does not exist"
Jul 06 20:51:34.037339 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.037310    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:34.039732 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.039705    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b01900e5-openshift-default-7d4f9d4667-n6zml"]
Jul 06 20:51:34.175909 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.175872    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2fb433-ebf7-489f-badd-45acc2e193be" path="/var/lib/kubelet/pods/8b2fb433-ebf7-489f-badd-45acc2e193be/volumes"
Jul 06 20:51:34.670681 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.670642    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:34.671061 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.671045    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2fb433-ebf7-489f-badd-45acc2e193be" containerName="istio-proxy"
Jul 06 20:51:34.671061 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.671056    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2fb433-ebf7-489f-badd-45acc2e193be" containerName="istio-proxy"
Jul 06 20:51:34.671140 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.671121    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b2fb433-ebf7-489f-badd-45acc2e193be" containerName="istio-proxy"
Jul 06 20:51:34.674427 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.674404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.677568 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.677544    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b097e72f-openshift-default-dockercfg-dc89r\""
Jul 06 20:51:34.726028 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.725987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:34.759729 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.759902 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.759902 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.759902 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhqz\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.759902 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.760053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.760053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.760053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.759990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.760053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.760019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861169 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861169 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861123    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861169 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861169 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhqz\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861577 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861571    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861663    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861961 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861901    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.861961 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.861917    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.862111 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.862093    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.863569 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.863538    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.863881 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.863861    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.874040 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.874000    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.874437 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.874414    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhqz\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz\") pod \"e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") " pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:34.985241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:34.985196    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:35.133055 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:35.133026    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:35.134800 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:51:35.134773    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8367c14c_4099_49fb_b55a_21e169474811.slice/crio-3ec63b2a84f60e1084e58d48dd837c8537f7764369978f99e81fd2d9571b27ea WatchSource:0}: Error finding container 3ec63b2a84f60e1084e58d48dd837c8537f7764369978f99e81fd2d9571b27ea: Status 404 returned error can't find the container with id 3ec63b2a84f60e1084e58d48dd837c8537f7764369978f99e81fd2d9571b27ea
Jul 06 20:51:35.136843 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:35.136814    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:35.136910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:35.136883    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:35.136945 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:35.136916    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:36.028635 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:36.028600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" event={"ID":"8367c14c-4099-49fb-b55a-21e169474811","Type":"ContainerStarted","Data":"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"}
Jul 06 20:51:36.029147 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:36.028648    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" event={"ID":"8367c14c-4099-49fb-b55a-21e169474811","Type":"ContainerStarted","Data":"3ec63b2a84f60e1084e58d48dd837c8537f7764369978f99e81fd2d9571b27ea"}
Jul 06 20:51:36.066874 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:36.066812    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" podStartSLOduration=2.066792738 podStartE2EDuration="2.066792738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:51:36.062847161 +0000 UTC m=+1658.498500339" watchObservedRunningTime="2026-07-06 20:51:36.066792738 +0000 UTC m=+1658.502445917"
Jul 06 20:51:36.985705 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:36.985668    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:36.990975 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:36.990946    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:37.034493 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:37.034459    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:37.035488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:37.035470    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:47.099377 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:47.099332    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:47.099840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:47.099538    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" podUID="8367c14c-4099-49fb-b55a-21e169474811" containerName="istio-proxy" containerID="cri-o://b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c" gracePeriod=30
Jul 06 20:51:50.364562 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.364530    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:50.423094 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423100    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423135    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423181    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nhqz\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423250    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423288 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423273    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423616 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423616 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423333    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo\") pod \"8367c14c-4099-49fb-b55a-21e169474811\" (UID: \"8367c14c-4099-49fb-b55a-21e169474811\") "
Jul 06 20:51:50.423616 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423450    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:50.423616 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423462    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:50.423899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423758    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.423899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423781    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.424009 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.423979    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data" (OuterVolumeSpecName: "istio-data") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:50.424096 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.424069    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:51:50.424439 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.424407    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:50.425936 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.425911    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:51:50.426134 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.426107    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz" (OuterVolumeSpecName: "kube-api-access-6nhqz") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "kube-api-access-6nhqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:51:50.426200 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.426111    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token" (OuterVolumeSpecName: "istio-token") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:51:50.426672 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.426653    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8367c14c-4099-49fb-b55a-21e169474811" (UID: "8367c14c-4099-49fb-b55a-21e169474811"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:51:50.524408 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524367    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524408 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524397    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nhqz\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-kube-api-access-6nhqz\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524408 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524408    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524408 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524417    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8367c14c-4099-49fb-b55a-21e169474811-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524425    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8367c14c-4099-49fb-b55a-21e169474811-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524433    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8367c14c-4099-49fb-b55a-21e169474811-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:50.524687 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:50.524440    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8367c14c-4099-49fb-b55a-21e169474811-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:51:51.126430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.126397    2571 generic.go:356] "Generic (PLEG): container finished" podID="8367c14c-4099-49fb-b55a-21e169474811" containerID="b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c" exitCode=0
Jul 06 20:51:51.126634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.126481    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"
Jul 06 20:51:51.126634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.126523    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" event={"ID":"8367c14c-4099-49fb-b55a-21e169474811","Type":"ContainerDied","Data":"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"}
Jul 06 20:51:51.126634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.126584    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v" event={"ID":"8367c14c-4099-49fb-b55a-21e169474811","Type":"ContainerDied","Data":"3ec63b2a84f60e1084e58d48dd837c8537f7764369978f99e81fd2d9571b27ea"}
Jul 06 20:51:51.126634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.126613    2571 scope.go:117] "RemoveContainer" containerID="b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"
Jul 06 20:51:51.140563 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.140536    2571 scope.go:117] "RemoveContainer" containerID="b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"
Jul 06 20:51:51.141095 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:51:51.141071    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c\": container with ID starting with b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c not found: ID does not exist" containerID="b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"
Jul 06 20:51:51.141209 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.141103    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c"} err="failed to get container status \"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c\": rpc error: code = NotFound desc = could not find container \"b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c\": container with ID starting with b9fdf8214da96c0b5d3f88db4ba8a815b73f0f8e9a836f48bbc1bb9a8710df2c not found: ID does not exist"
Jul 06 20:51:51.154035 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.153994    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:51.159924 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:51.159896    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b097e72f-openshift-default-75db86d675-q9x4v"]
Jul 06 20:51:52.176667 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:52.176635    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8367c14c-4099-49fb-b55a-21e169474811" path="/var/lib/kubelet/pods/8367c14c-4099-49fb-b55a-21e169474811/volumes"
Jul 06 20:51:53.293004 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.292973    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:51:53.293678 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.293652    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8367c14c-4099-49fb-b55a-21e169474811" containerName="istio-proxy"
Jul 06 20:51:53.293778 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.293680    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8367c14c-4099-49fb-b55a-21e169474811" containerName="istio-proxy"
Jul 06 20:51:53.293828 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.293792    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8367c14c-4099-49fb-b55a-21e169474811" containerName="istio-proxy"
Jul 06 20:51:53.298832 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.298804    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.301585 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.301561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0f2dbdef-openshift-default-dockercfg-ztdg2\""
Jul 06 20:51:53.311583 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.311547    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:51:53.449582 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449582 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.449840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.450042 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzhc\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.450042 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.449864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551436 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551436 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551688 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551688 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551688 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551714    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzhc\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551794    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.551856 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.551835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.552125 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.552061    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.552183 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.552121    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.552240 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.552192    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.552300 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.552244    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.554015 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.553976    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.554240 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.554220    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.562194 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.562161    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.563407 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.563343    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzhc\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc\") pod \"e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") " pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.612970 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.612930    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:53.777123 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.777092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:51:53.779519 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:51:53.779491    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98da1cec_830e_42b1_b2f9_c5327c97c2a7.slice/crio-156ce41f3ac013f66a85aac21609c0484083508f2d5bea1996b02e359b1d0c7f WatchSource:0}: Error finding container 156ce41f3ac013f66a85aac21609c0484083508f2d5bea1996b02e359b1d0c7f: Status 404 returned error can't find the container with id 156ce41f3ac013f66a85aac21609c0484083508f2d5bea1996b02e359b1d0c7f
Jul 06 20:51:53.781614 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.781552    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:53.781725 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.781653    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:53.781725 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:53.781689    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:51:54.147112 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:54.147070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" event={"ID":"98da1cec-830e-42b1-b2f9-c5327c97c2a7","Type":"ContainerStarted","Data":"f3295ce549bc9f76ac2d58c5a56f6762f4a00c4e8c0f25941eae2d99924d1296"}
Jul 06 20:51:54.147321 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:54.147139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" event={"ID":"98da1cec-830e-42b1-b2f9-c5327c97c2a7","Type":"ContainerStarted","Data":"156ce41f3ac013f66a85aac21609c0484083508f2d5bea1996b02e359b1d0c7f"}
Jul 06 20:51:54.172011 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:54.171958    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" podStartSLOduration=1.17193764 podStartE2EDuration="1.17193764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:51:54.170128063 +0000 UTC m=+1676.605781243" watchObservedRunningTime="2026-07-06 20:51:54.17193764 +0000 UTC m=+1676.607590819"
Jul 06 20:51:54.613979 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:54.613941    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:54.619059 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:54.619031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:55.153036 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:55.152999    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:55.154020 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:55.153982    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:51:59.069746 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:59.069690    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:51:59.070634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:51:59.070573    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" podUID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" containerName="istio-proxy" containerID="cri-o://f3295ce549bc9f76ac2d58c5a56f6762f4a00c4e8c0f25941eae2d99924d1296" gracePeriod=30
Jul 06 20:52:05.223398 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.223330    2571 generic.go:356] "Generic (PLEG): container finished" podID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" containerID="f3295ce549bc9f76ac2d58c5a56f6762f4a00c4e8c0f25941eae2d99924d1296" exitCode=0
Jul 06 20:52:05.223929 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.223405    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" event={"ID":"98da1cec-830e-42b1-b2f9-c5327c97c2a7","Type":"ContainerDied","Data":"f3295ce549bc9f76ac2d58c5a56f6762f4a00c4e8c0f25941eae2d99924d1296"}
Jul 06 20:52:05.337444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.337417    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:52:05.390407 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390375    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390438    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390482    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390519    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdzhc\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390588    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390634 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390626    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390979 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390665    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.390979 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390699    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert\") pod \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\" (UID: \"98da1cec-830e-42b1-b2f9-c5327c97c2a7\") "
Jul 06 20:52:05.391095 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.390972    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:52:05.391153 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.391102    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:52:05.391285 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.391259    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:52:05.391410 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.391387    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:52:05.392101 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.392069    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:52:05.392808 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.392778    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:52:05.392808 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.392791    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:52:05.392934 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.392863    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:52:05.393664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.393644    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc" (OuterVolumeSpecName: "kube-api-access-pdzhc") pod "98da1cec-830e-42b1-b2f9-c5327c97c2a7" (UID: "98da1cec-830e-42b1-b2f9-c5327c97c2a7"). InnerVolumeSpecName "kube-api-access-pdzhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:52:05.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491561    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491594    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491603    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdzhc\" (UniqueName: \"kubernetes.io/projected/98da1cec-830e-42b1-b2f9-c5327c97c2a7-kube-api-access-pdzhc\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491614    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491606 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491622    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491913 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491630    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491913 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491638    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491913 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491646    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:05.491913 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:05.491654    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98da1cec-830e-42b1-b2f9-c5327c97c2a7-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:52:06.231110 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:06.231081    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"
Jul 06 20:52:06.231579 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:06.231117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5" event={"ID":"98da1cec-830e-42b1-b2f9-c5327c97c2a7","Type":"ContainerDied","Data":"156ce41f3ac013f66a85aac21609c0484083508f2d5bea1996b02e359b1d0c7f"}
Jul 06 20:52:06.231579 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:06.231181    2571 scope.go:117] "RemoveContainer" containerID="f3295ce549bc9f76ac2d58c5a56f6762f4a00c4e8c0f25941eae2d99924d1296"
Jul 06 20:52:06.251041 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:06.250971    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:52:06.268680 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:06.268647    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0f2dbdef-openshift-default-554f4c59-pzmd5"]
Jul 06 20:52:08.176981 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:52:08.176943    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" path="/var/lib/kubelet/pods/98da1cec-830e-42b1-b2f9-c5327c97c2a7/volumes"
Jul 06 20:53:42.922222 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.922184    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:53:42.922752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.922607    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" containerName="istio-proxy"
Jul 06 20:53:42.922752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.922619    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" containerName="istio-proxy"
Jul 06 20:53:42.922752 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.922696    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="98da1cec-830e-42b1-b2f9-c5327c97c2a7" containerName="istio-proxy"
Jul 06 20:53:42.924742 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.924725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:42.927569 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.927542    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-58c7cdd8-openshift-default-dockercfg-kpdl4\""
Jul 06 20:53:42.953394 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:42.953342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:53:43.054171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhkc\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054375    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.054510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.054499    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156050 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156007    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156050 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156289    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhkc\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156618    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156701 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156678    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156880    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.156964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.156942    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.158727 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.158706    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.158798 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.158786    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.167462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.167427    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.168645 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.168618    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhkc\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc\") pod \"e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") " pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.236521 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.236425    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:43.393594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.393569    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:53:43.395824 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:53:43.395797    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12002903_ed13_44ea_8cb0_47a4393f3b0c.slice/crio-61134fda5f41f6e9059d8377a3d7aa32ea6ae827f214406dcb391ba6c67ca476 WatchSource:0}: Error finding container 61134fda5f41f6e9059d8377a3d7aa32ea6ae827f214406dcb391ba6c67ca476: Status 404 returned error can't find the container with id 61134fda5f41f6e9059d8377a3d7aa32ea6ae827f214406dcb391ba6c67ca476
Jul 06 20:53:43.398233 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.398202    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:43.398319 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.398271    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:43.398319 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.398299    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:43.778977 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.778941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerStarted","Data":"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"}
Jul 06 20:53:43.779180 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.779003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerStarted","Data":"61134fda5f41f6e9059d8377a3d7aa32ea6ae827f214406dcb391ba6c67ca476"}
Jul 06 20:53:43.822297 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:43.822227    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podStartSLOduration=1.822200915 podStartE2EDuration="1.822200915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:53:43.819627141 +0000 UTC m=+1786.255280320" watchObservedRunningTime="2026-07-06 20:53:43.822200915 +0000 UTC m=+1786.257854095"
Jul 06 20:53:44.237093 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:44.237055    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:44.238478 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:44.238453    2571 patch_prober.go:28] interesting pod/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:53:44.238594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:44.238527    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:53:45.241236 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:45.241203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:45.790512 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:45.790478    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:45.791664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:45.791640    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:53:58.872103 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.872062    2571 generic.go:356] "Generic (PLEG): container finished" podID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerID="e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091" exitCode=0
Jul 06 20:53:58.872593 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.872134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerDied","Data":"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"}
Jul 06 20:53:58.872657 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.872592    2571 scope.go:117] "RemoveContainer" containerID="e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"
Jul 06 20:53:58.873684 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.873657    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:58.873784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.873724    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:58.873784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:58.873755    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:53:59.883987 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:53:59.883947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerStarted","Data":"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"}
Jul 06 20:54:00.237465 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:00.237343    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:00.238700 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:00.238673    2571 patch_prober.go:28] interesting pod/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:54:00.238829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:00.238724    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:54:00.790924 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:00.790882    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:01.237414 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:01.237342    2571 patch_prober.go:28] interesting pod/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:54:01.237812 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:01.237450    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:54:02.237266 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:02.237232    2571 patch_prober.go:28] interesting pod/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:54:02.237484 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:02.237302    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:54:03.236789 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:03.236753    2571 patch_prober.go:28] interesting pod/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:54:03.236973 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:03.236844    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:54:04.240882 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:04.240850    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:04.242052 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:04.242028    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:04.691181 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:04.691146    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:54:04.915314 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:04.915277    2571 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" secret="" err="secret \"e2e-mt-58c7cdd8-openshift-default-dockercfg-kpdl4\" not found"
Jul 06 20:54:05.921255 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:05.921207    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy" containerID="cri-o://8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7" gracePeriod=30
Jul 06 20:54:11.190948 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.190876    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:11.251479 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251436    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.251673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251612    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.251673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251656    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhkc\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.251805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251687    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.251805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251717    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.251805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251743    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.252037 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.251983    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:54:11.252224 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.252199    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:54:11.253204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.252980    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:54:11.253204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253111    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.253204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253192    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.253488 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253219    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket\") pod \"12002903-ed13-44ea-8cb0-47a4393f3b0c\" (UID: \"12002903-ed13-44ea-8cb0-47a4393f3b0c\") "
Jul 06 20:54:11.253988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253648    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.253988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253673    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.253988 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.253687    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.254304 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.254269    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:54:11.254533 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.254514    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:54:11.254637 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.254609    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc" (OuterVolumeSpecName: "kube-api-access-hkhkc") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "kube-api-access-hkhkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:54:11.254755 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.254723    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:54:11.255250 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.255228    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:54:11.256222 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.256199    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12002903-ed13-44ea-8cb0-47a4393f3b0c" (UID: "12002903-ed13-44ea-8cb0-47a4393f3b0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:54:11.354201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354163    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12002903-ed13-44ea-8cb0-47a4393f3b0c-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.354201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354192    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.354201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354201    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12002903-ed13-44ea-8cb0-47a4393f3b0c-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.354201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354212    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.354501 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354220    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.354501 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.354228    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhkc\" (UniqueName: \"kubernetes.io/projected/12002903-ed13-44ea-8cb0-47a4393f3b0c-kube-api-access-hkhkc\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:54:11.956879 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.956849    2571 generic.go:356] "Generic (PLEG): container finished" podID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerID="8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7" exitCode=0
Jul 06 20:54:11.957051 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.956895    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"
Jul 06 20:54:11.957051 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.956911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerDied","Data":"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"}
Jul 06 20:54:11.957051 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.956953    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn" event={"ID":"12002903-ed13-44ea-8cb0-47a4393f3b0c","Type":"ContainerDied","Data":"61134fda5f41f6e9059d8377a3d7aa32ea6ae827f214406dcb391ba6c67ca476"}
Jul 06 20:54:11.957051 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.956974    2571 scope.go:117] "RemoveContainer" containerID="8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"
Jul 06 20:54:11.969483 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.969454    2571 scope.go:117] "RemoveContainer" containerID="e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"
Jul 06 20:54:11.978653 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.978627    2571 scope.go:117] "RemoveContainer" containerID="8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"
Jul 06 20:54:11.978994 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:54:11.978975    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7\": container with ID starting with 8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7 not found: ID does not exist" containerID="8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"
Jul 06 20:54:11.979071 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.979004    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7"} err="failed to get container status \"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7\": rpc error: code = NotFound desc = could not find container \"8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7\": container with ID starting with 8f6b3f0d57435551c0566787fb17296bf46e48fe67f81f44b9dc27bbf55861b7 not found: ID does not exist"
Jul 06 20:54:11.979071 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.979024    2571 scope.go:117] "RemoveContainer" containerID="e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"
Jul 06 20:54:11.979294 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:54:11.979275    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091\": container with ID starting with e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091 not found: ID does not exist" containerID="e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"
Jul 06 20:54:11.979338 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.979300    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091"} err="failed to get container status \"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091\": rpc error: code = NotFound desc = could not find container \"e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091\": container with ID starting with e2d8616f405df3ecdb1c43a67c611f1f9cfa94d86bd7bd0cb1e75187d2de1091 not found: ID does not exist"
Jul 06 20:54:11.987340 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.987305    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:54:11.994737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:11.994707    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-58c7cdd8-openshift-default-5ccd796947-6mbqn"]
Jul 06 20:54:12.175526 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:12.175492    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" path="/var/lib/kubelet/pods/12002903-ed13-44ea-8cb0-47a4393f3b0c/volumes"
Jul 06 20:54:25.061063 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061028    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:54:25.061528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061513    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.061528 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061529    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.061610 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061546    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.061610 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061552    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.061673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061620    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.061673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.061631    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="12002903-ed13-44ea-8cb0-47a4393f3b0c" containerName="istio-proxy"
Jul 06 20:54:25.066305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.066285    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.070506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.070480    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1726c2fe-openshift-default-dockercfg-77q6w\""
Jul 06 20:54:25.082412 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.082350    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:54:25.187377 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187441    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187557 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.187754 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.187625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w64fr\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w64fr\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289423 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289423 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289423 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289601 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289601 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289601 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289601 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289645    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289901 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289875    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.289964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.289901    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.290077 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.290053    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.290140 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.290086    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.291551 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.291531    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.291910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.291893    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.301012 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.300981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.302120 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.302099    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w64fr\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr\") pod \"e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") " pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.377602 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.377569    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:25.529350 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.529324    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:54:25.530829 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:54:25.530805    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679b28ed_a7e1_43fb_bf85_0a01c71d3a87.slice/crio-096fe4ff8a7241054b10967ff4827b3ab7d58642d6e578727e40eb860eec2027 WatchSource:0}: Error finding container 096fe4ff8a7241054b10967ff4827b3ab7d58642d6e578727e40eb860eec2027: Status 404 returned error can't find the container with id 096fe4ff8a7241054b10967ff4827b3ab7d58642d6e578727e40eb860eec2027
Jul 06 20:54:25.532964 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.532929    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:25.533068 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.533003    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:25.533068 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:25.533033    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:26.038151 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:26.038115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerStarted","Data":"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"}
Jul 06 20:54:26.038338 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:26.038166    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerStarted","Data":"096fe4ff8a7241054b10967ff4827b3ab7d58642d6e578727e40eb860eec2027"}
Jul 06 20:54:26.062844 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:26.062785    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podStartSLOduration=1.062763895 podStartE2EDuration="1.062763895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:54:26.062192179 +0000 UTC m=+1828.497845369" watchObservedRunningTime="2026-07-06 20:54:26.062763895 +0000 UTC m=+1828.498417072"
Jul 06 20:54:26.378585 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:26.378551    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:26.384809 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:26.384778    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:27.044229 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:27.044199    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:27.045348 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:27.045330    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:42.292455 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:42.291730    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:39512->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Jul 06 20:54:42.292455 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:42.291812    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:39512->10.134.0.51:15021: read: connection reset by peer"
Jul 06 20:54:43.146745 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.146704    2571 generic.go:356] "Generic (PLEG): container finished" podID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerID="1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd" exitCode=0
Jul 06 20:54:43.146971 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.146794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerDied","Data":"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"}
Jul 06 20:54:43.147300 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.147283    2571 scope.go:117] "RemoveContainer" containerID="1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"
Jul 06 20:54:43.148595 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.148566    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:43.148685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.148636    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:43.148685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:43.148667    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:54:44.154894 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:44.154859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerStarted","Data":"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"}
Jul 06 20:54:44.378222 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:44.378178    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:44.378907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:44.378453    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:54:44.378907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:44.378606    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:54:45.378492 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:45.378451    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:54:45.379138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:45.379101    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:54:46.378871 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:46.378833    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:54:46.379576 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:46.379541    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:54:47.378506 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:47.378461    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:54:47.378865 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:47.378830    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:54:48.378903 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:48.378861    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:54:48.379546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:48.379508    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:54:49.382366 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:49.382331    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:49.382871 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:49.382769    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:54:49.383482 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:54:49.383459    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:55:45.202458 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:45.202373    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:55:45.202974 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:45.202633    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" containerID="cri-o://a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954" gracePeriod=30
Jul 06 20:55:49.385044 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:49.385001    2571 patch_prober.go:28] interesting pod/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:55:49.385513 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:49.385074    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:55:50.459739 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.459712    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:55:50.540729 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540635    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w64fr\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.540729 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540685    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.540729 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540707    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.540729 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540725    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541072 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540758    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541072 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540811    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541072 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540872    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541072 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540901    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541072 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.540948    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy\") pod \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\" (UID: \"679b28ed-a7e1-43fb-bf85-0a01c71d3a87\") "
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541034    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541128    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541134    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541324    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541346    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.541413 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541381    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.541654 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541464    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:55:50.541819 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.541792    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data" (OuterVolumeSpecName: "istio-data") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:55:50.543081 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.543044    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token" (OuterVolumeSpecName: "istio-token") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:55:50.543201 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.543104    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:55:50.543510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.543484    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr" (OuterVolumeSpecName: "kube-api-access-w64fr") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "kube-api-access-w64fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:55:50.543510 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.543481    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "679b28ed-a7e1-43fb-bf85-0a01c71d3a87" (UID: "679b28ed-a7e1-43fb-bf85-0a01c71d3a87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:55:50.556129 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.556089    2571 generic.go:356] "Generic (PLEG): container finished" podID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerID="a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954" exitCode=0
Jul 06 20:55:50.556275 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.556145    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"
Jul 06 20:55:50.556275 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.556163    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerDied","Data":"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"}
Jul 06 20:55:50.556275 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.556257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s" event={"ID":"679b28ed-a7e1-43fb-bf85-0a01c71d3a87","Type":"ContainerDied","Data":"096fe4ff8a7241054b10967ff4827b3ab7d58642d6e578727e40eb860eec2027"}
Jul 06 20:55:50.556424 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.556281    2571 scope.go:117] "RemoveContainer" containerID="a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"
Jul 06 20:55:50.566163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.566135    2571 scope.go:117] "RemoveContainer" containerID="1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"
Jul 06 20:55:50.575260 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.575238    2571 scope.go:117] "RemoveContainer" containerID="a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"
Jul 06 20:55:50.575576 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:55:50.575557    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954\": container with ID starting with a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954 not found: ID does not exist" containerID="a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"
Jul 06 20:55:50.575659 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.575583    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954"} err="failed to get container status \"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954\": rpc error: code = NotFound desc = could not find container \"a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954\": container with ID starting with a0312c9564708685b753255c8d623a53a0d80b9d834f8e9d8632918e94e9d954 not found: ID does not exist"
Jul 06 20:55:50.575659 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.575602    2571 scope.go:117] "RemoveContainer" containerID="1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"
Jul 06 20:55:50.575846 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:55:50.575831    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd\": container with ID starting with 1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd not found: ID does not exist" containerID="1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"
Jul 06 20:55:50.575887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.575851    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd"} err="failed to get container status \"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd\": rpc error: code = NotFound desc = could not find container \"1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd\": container with ID starting with 1925e60a18ee4490e0e922062ae3b084e70f10104c57c9098f26008b2e88e9fd not found: ID does not exist"
Jul 06 20:55:50.584189 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.584161    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:55:50.587185 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.587155    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1726c2fe-openshift-default-df6d8479-lxt6s"]
Jul 06 20:55:50.642448 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642409    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.642448 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642441    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.642448 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642453    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.642746 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642463    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.642746 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642478    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:50.642746 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:50.642492    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w64fr\" (UniqueName: \"kubernetes.io/projected/679b28ed-a7e1-43fb-bf85-0a01c71d3a87-kube-api-access-w64fr\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:55:52.176373 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:55:52.176324    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" path="/var/lib/kubelet/pods/679b28ed-a7e1-43fb-bf85-0a01c71d3a87/volumes"
Jul 06 20:56:44.356787 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.356749    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:56:44.357265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357160    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.357265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357175    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.357265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357184    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.357265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357189    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.357420 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357268    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.357420 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.357278    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="679b28ed-a7e1-43fb-bf85-0a01c71d3a87" containerName="istio-proxy"
Jul 06 20:56:44.360469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.360452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.363137 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.363117    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8e767e-openshift-default-dockercfg-ffr8m\""
Jul 06 20:56:44.376514 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.376486    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:56:44.530645 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txgdt\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530645 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530770    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.530918 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.531095 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.531095 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.530983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632209 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632209 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632428    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txgdt\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632496 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632829 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632705    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.632915 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.632885    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.633046 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.633000    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.633122 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.633051    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.633261 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.633239    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.634751 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.634727    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.634872 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.634856    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.641074 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.641041    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.641231 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.641209    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txgdt\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt\") pod \"e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") " pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.671740 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.671703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:44.815108 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.815084    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:56:44.817098 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:56:44.817068    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc614e66_0d6f_4000_beff_ce6e5dd7d6f4.slice/crio-cef4cda5f4e0786a9c07a271c0738eea89d36b1758485b2b4b9c2a0ee244cf54 WatchSource:0}: Error finding container cef4cda5f4e0786a9c07a271c0738eea89d36b1758485b2b4b9c2a0ee244cf54: Status 404 returned error can't find the container with id cef4cda5f4e0786a9c07a271c0738eea89d36b1758485b2b4b9c2a0ee244cf54
Jul 06 20:56:44.819237 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.819208    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:44.819315 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.819272    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:44.819315 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.819303    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:44.874409 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:44.874375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerStarted","Data":"cef4cda5f4e0786a9c07a271c0738eea89d36b1758485b2b4b9c2a0ee244cf54"}
Jul 06 20:56:45.881088 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:45.881049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerStarted","Data":"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"}
Jul 06 20:56:46.672674 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:46.672632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:46.677846 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:46.677814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:46.703107 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:46.703052    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podStartSLOduration=2.703033541 podStartE2EDuration="2.703033541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:56:45.929195278 +0000 UTC m=+1968.364848456" watchObservedRunningTime="2026-07-06 20:56:46.703033541 +0000 UTC m=+1969.138686717"
Jul 06 20:56:46.886305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:46.886270    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:46.887327 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:46.887310    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:56:53.058184 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.058110    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:56:53.062594 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.062573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.066303 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.066273    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-60229a-openshift-default-dockercfg-kmdr8\""
Jul 06 20:56:53.078688 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.078663    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:56:53.111887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.111850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.111887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.111890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.111913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.111957    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.112007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.112031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.112057    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112113 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.112075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.112305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.112152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2fhf\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213040 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213040 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213270 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2fhf\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213270 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213270 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213270 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213573 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213730 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213658    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213831    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213836    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213866    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.213910 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.213900    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.215551 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.215530    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.215853 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.215833    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.221903 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.221880    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.222100 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.222079    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2fhf\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf\") pod \"e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") " pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.375718 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.375682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:53.525190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.525166    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:56:53.527233 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:56:53.527205    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd28ba2f_07db_4082_822d_416ecd67d044.slice/crio-844a127a642f62c9892ddef4a252314481483bc887aab6291e24fb106794c1e7 WatchSource:0}: Error finding container 844a127a642f62c9892ddef4a252314481483bc887aab6291e24fb106794c1e7: Status 404 returned error can't find the container with id 844a127a642f62c9892ddef4a252314481483bc887aab6291e24fb106794c1e7
Jul 06 20:56:53.529344 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.529310    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:53.529461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.529407    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:53.529461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.529453    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:56:53.926651 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.926613    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerStarted","Data":"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"}
Jul 06 20:56:53.926844 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.926662    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerStarted","Data":"844a127a642f62c9892ddef4a252314481483bc887aab6291e24fb106794c1e7"}
Jul 06 20:56:53.952598 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:53.952535    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podStartSLOduration=0.952488728 podStartE2EDuration="952.488728ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:56:53.951089932 +0000 UTC m=+1976.386743103" watchObservedRunningTime="2026-07-06 20:56:53.952488728 +0000 UTC m=+1976.388141905"
Jul 06 20:56:54.376766 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:54.376725    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:54.378434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:54.378410    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:56:54.378558 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:54.378458    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 06 20:56:55.390170 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:55.390137    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:55.938217 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:55.938177    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:56:55.939211 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:56:55.939192    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:57:02.040004 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.039552    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:40048->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Jul 06 20:57:02.040004 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.039638    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:40048->10.134.0.52:15021: read: connection reset by peer"
Jul 06 20:57:02.986691 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.986648    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerID="3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a" exitCode=0
Jul 06 20:57:02.987132 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.986967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerDied","Data":"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"}
Jul 06 20:57:02.987903 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.987884    2571 scope.go:117] "RemoveContainer" containerID="3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"
Jul 06 20:57:02.989542 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.989504    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:02.989756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.989733    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:02.989909 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:02.989891    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:04.003982 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:04.003887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerStarted","Data":"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"}
Jul 06 20:57:04.672998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:04.672967    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:57:04.673284 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:04.673024    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 20:57:04.673451 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:04.673427    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 20:57:05.673161 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:05.673107    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 20:57:05.673708 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:05.673200    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 20:57:06.672605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:06.672555    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 20:57:06.672821 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:06.672629    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 20:57:07.673218 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:07.673169    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 20:57:07.673772 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:07.673240    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 20:57:08.027834 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.027743    2571 generic.go:356] "Generic (PLEG): container finished" podID="dd28ba2f-07db-4082-822d-416ecd67d044" containerID="a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182" exitCode=0
Jul 06 20:57:08.027977 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.027824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerDied","Data":"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"}
Jul 06 20:57:08.028264 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.028250    2571 scope.go:117] "RemoveContainer" containerID="a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"
Jul 06 20:57:08.029344 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.029318    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:08.029446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.029399    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:08.029446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.029431    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:57:08.675871 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.675842    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:57:08.676334 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.676113    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:57:08.676820 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:08.676804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:57:09.035819 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:09.035737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerStarted","Data":"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"}
Jul 06 20:57:09.376380 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:09.376329    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:57:09.377984 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:09.377943    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:57:09.378255 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:09.378214    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 06 20:57:10.377107 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:10.377057    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:57:10.377641 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:10.377148    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 06 20:57:10.939126 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:10.939093    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:57:11.376731 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:11.376682    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:57:11.376927 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:11.376769    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 06 20:57:12.377135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:12.377092    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 06 20:57:12.377759 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:12.377726    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 06 20:57:13.381588 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:13.381550    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:57:13.382802 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:57:13.382781    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:58:48.565278 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:48.565238    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:58:48.565880 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:48.565478    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" containerID="cri-o://4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a" gracePeriod=30
Jul 06 20:58:53.678141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.678105    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 20:58:53.678534 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.678162    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 20:58:53.826141 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.826080    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:58:53.941939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.941900    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.941962    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.941991    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942028    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942050    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942066    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942092    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942138 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942125    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942202    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txgdt\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt\") pod \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\" (UID: \"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4\") "
Jul 06 20:58:53.942546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942259    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:58:53.942546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942407    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:58:53.942546 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942485    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:58:53.942761 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942614    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:53.942761 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942634    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:53.942761 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942649    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:53.942911 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.942796    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:58:53.943105 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.943081    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:58:53.944636 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.944608    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt" (OuterVolumeSpecName: "kube-api-access-txgdt") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "kube-api-access-txgdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:58:53.944763 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.944633    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:58:53.944881 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.944856    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:58:53.944940 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:53.944865    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" (UID: "dc614e66-0d6f-4000-beff-ce6e5dd7d6f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:58:54.043345 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043306    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txgdt\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-kube-api-access-txgdt\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.043345 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043339    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.043345 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043349    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.043708 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043392    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.043708 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043401    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.043708 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.043408    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:58:54.633013 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.632981    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerID="4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a" exitCode=0
Jul 06 20:58:54.633197 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.633030    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"
Jul 06 20:58:54.633197 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.633050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerDied","Data":"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"}
Jul 06 20:58:54.633197 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.633092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh" event={"ID":"dc614e66-0d6f-4000-beff-ce6e5dd7d6f4","Type":"ContainerDied","Data":"cef4cda5f4e0786a9c07a271c0738eea89d36b1758485b2b4b9c2a0ee244cf54"}
Jul 06 20:58:54.633197 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.633117    2571 scope.go:117] "RemoveContainer" containerID="4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"
Jul 06 20:58:54.642869 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.642849    2571 scope.go:117] "RemoveContainer" containerID="3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"
Jul 06 20:58:54.653990 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.652235    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:58:54.654787 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.654764    2571 scope.go:117] "RemoveContainer" containerID="4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"
Jul 06 20:58:54.655640 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:58:54.655612    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a\": container with ID starting with 4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a not found: ID does not exist" containerID="4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"
Jul 06 20:58:54.655767 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.655651    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a"} err="failed to get container status \"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a\": rpc error: code = NotFound desc = could not find container \"4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a\": container with ID starting with 4ccc9846cbfa2ed617b5b390b27d3ae9212df50779b7fe309b331572b1fd882a not found: ID does not exist"
Jul 06 20:58:54.655767 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.655679    2571 scope.go:117] "RemoveContainer" containerID="3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"
Jul 06 20:58:54.656070 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:58:54.656042    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a\": container with ID starting with 3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a not found: ID does not exist" containerID="3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"
Jul 06 20:58:54.656161 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.656077    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a"} err="failed to get container status \"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a\": rpc error: code = NotFound desc = could not find container \"3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a\": container with ID starting with 3e85d197b9f38c0af302edc721cd7754667b7f4a1dd1b5997f700e5dd18a293a not found: ID does not exist"
Jul 06 20:58:54.658135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:54.658109    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8e767e-openshift-default-6dff858b5c-zbslh"]
Jul 06 20:58:55.727529 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:55.727495    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:58:55.728017 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:55.727753    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" containerID="cri-o://e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a" gracePeriod=30
Jul 06 20:58:56.176499 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.176471    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" path="/var/lib/kubelet/pods/dc614e66-0d6f-4000-beff-ce6e5dd7d6f4/volumes"
Jul 06 20:58:56.810047 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810007    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:58:56.810462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810453    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.810550 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810465    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.810550 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810488    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.810550 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810495    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.810713 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810553    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.810713 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.810563    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc614e66-0d6f-4000-beff-ce6e5dd7d6f4" containerName="istio-proxy"
Jul 06 20:58:56.815080 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.815060    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.822686 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.822046    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c6b4b3-openshift-default-dockercfg-jnp4k\""
Jul 06 20:58:56.836882 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.836851    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:58:56.872746 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.872950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.872950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.872950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872847    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.872950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.873190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.872954    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49xs\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.873190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.873028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.873190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.873075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.873190 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.873102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974618 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974618 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c49xs\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.974877 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.974861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.975265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.975125    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.975265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.975159    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.975459 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.975430    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.975569 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.975441    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.975569 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.975510    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.977031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.977010    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.977148 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.977131    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.983298 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.983259    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:56.983441 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:56.983269    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49xs\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs\") pod \"e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") " pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:57.126424 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.126386    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:57.282241 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.282210    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:58:57.283050 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:58:57.283020    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57fbabf_7007_4d40_bba9_93f917efd41b.slice/crio-e05c06d21a5c55573200241c7c2c723cbef070e2ffbbb426b6c1d8558200a11a WatchSource:0}: Error finding container e05c06d21a5c55573200241c7c2c723cbef070e2ffbbb426b6c1d8558200a11a: Status 404 returned error can't find the container with id e05c06d21a5c55573200241c7c2c723cbef070e2ffbbb426b6c1d8558200a11a
Jul 06 20:58:57.285227 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.285189    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:58:57.285294 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.285279    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:58:57.285337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.285324    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:58:57.655175 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.655137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerStarted","Data":"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"}
Jul 06 20:58:57.655379 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.655194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerStarted","Data":"e05c06d21a5c55573200241c7c2c723cbef070e2ffbbb426b6c1d8558200a11a"}
Jul 06 20:58:57.712395 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:57.712327    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podStartSLOduration=1.712309409 podStartE2EDuration="1.712309409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:58:57.709430599 +0000 UTC m=+2100.145083774" watchObservedRunningTime="2026-07-06 20:58:57.712309409 +0000 UTC m=+2100.147962587"
Jul 06 20:58:58.127457 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.127427    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:58.132685 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.132659    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:58.384772 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.384681    2571 patch_prober.go:28] interesting pod/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:58:58.384772 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.384742    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:58:58.661469 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.661386    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:58:58.662570 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:58:58.662550    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:00.990855 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:00.990782    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:59:01.119143 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119194    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119246    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2fhf\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119271    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119297    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119337 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119689 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119399    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119689 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119451    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy\") pod \"dd28ba2f-07db-4082-822d-416ecd67d044\" (UID: \"dd28ba2f-07db-4082-822d-416ecd67d044\") "
Jul 06 20:59:01.119796 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119754    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:01.119796 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119778    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:01.119938 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119917    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.119995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119944    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:01.119995 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.119945    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.120102 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.120068    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:59:01.120199 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.120176    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:01.121736 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.121704    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf" (OuterVolumeSpecName: "kube-api-access-n2fhf") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "kube-api-access-n2fhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:01.121840 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.121748    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:01.121931 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.121912    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:01.122059 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.122043    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd28ba2f-07db-4082-822d-416ecd67d044" (UID: "dd28ba2f-07db-4082-822d-416ecd67d044"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:59:01.221238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221193    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221229    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221238    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd28ba2f-07db-4082-822d-416ecd67d044-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221245    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd28ba2f-07db-4082-822d-416ecd67d044-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221253    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221261    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2fhf\" (UniqueName: \"kubernetes.io/projected/dd28ba2f-07db-4082-822d-416ecd67d044-kube-api-access-n2fhf\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.221572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.221269    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd28ba2f-07db-4082-822d-416ecd67d044-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:01.682871 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.682835    2571 generic.go:356] "Generic (PLEG): container finished" podID="dd28ba2f-07db-4082-822d-416ecd67d044" containerID="e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a" exitCode=0
Jul 06 20:59:01.682871 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.682888    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"
Jul 06 20:59:01.683167 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.682922    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerDied","Data":"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"}
Jul 06 20:59:01.683167 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.682996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc" event={"ID":"dd28ba2f-07db-4082-822d-416ecd67d044","Type":"ContainerDied","Data":"844a127a642f62c9892ddef4a252314481483bc887aab6291e24fb106794c1e7"}
Jul 06 20:59:01.683167 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.683027    2571 scope.go:117] "RemoveContainer" containerID="e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"
Jul 06 20:59:01.693305 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.693286    2571 scope.go:117] "RemoveContainer" containerID="a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"
Jul 06 20:59:01.702151 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.702128    2571 scope.go:117] "RemoveContainer" containerID="e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"
Jul 06 20:59:01.702437 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:01.702420    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a\": container with ID starting with e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a not found: ID does not exist" containerID="e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"
Jul 06 20:59:01.702505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.702449    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a"} err="failed to get container status \"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a\": rpc error: code = NotFound desc = could not find container \"e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a\": container with ID starting with e06b59715ccf924a7df2f9886f1fde45bf687b26c25e24953daf064a46256e9a not found: ID does not exist"
Jul 06 20:59:01.702505 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.702467    2571 scope.go:117] "RemoveContainer" containerID="a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"
Jul 06 20:59:01.702699 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:01.702683    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182\": container with ID starting with a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182 not found: ID does not exist" containerID="a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"
Jul 06 20:59:01.702737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.702702    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182"} err="failed to get container status \"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182\": rpc error: code = NotFound desc = could not find container \"a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182\": container with ID starting with a31931ea8d3f12b9cf9af6d41996a5a5f06f036e68690280e4238ceff4165182 not found: ID does not exist"
Jul 06 20:59:01.706673 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.706647    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:59:01.711399 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:01.711375    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-60229a-openshift-default-65b568cb59-mlrxc"]
Jul 06 20:59:02.175605 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:02.175570    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" path="/var/lib/kubelet/pods/dd28ba2f-07db-4082-822d-416ecd67d044/volumes"
Jul 06 20:59:05.030042 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.029997    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:05.030899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.030515    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:05.030899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.030531    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:05.030899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.030625    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:05.030899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.030637    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:05.033760 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.033736    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.036941 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.036915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-275fd7-openshift-default-dockercfg-vhfpx\""
Jul 06 20:59:05.049265 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.049232    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:05.155978 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.155936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.155978 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.155984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chf7t\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156254 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.156529 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.156315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257281 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chf7t\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257281 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257572 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257888 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257803    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.257991 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.257974    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.258088 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.258066    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.258154 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.258112    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.258302 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.258283    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.260049 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.260025    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.260158 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.260137    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.266107 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.266081    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.266368 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.266337    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chf7t\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t\") pod \"e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") " pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.344965 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.344872    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:05.504097 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.504071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:05.507026 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:59:05.506998    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a7cb26_d284_44d9_8dbc_0ccba61f37d0.slice/crio-699885102f214cace57241d985327bae66d6aa22d1d23f2ab396e4e06105788a WatchSource:0}: Error finding container 699885102f214cace57241d985327bae66d6aa22d1d23f2ab396e4e06105788a: Status 404 returned error can't find the container with id 699885102f214cace57241d985327bae66d6aa22d1d23f2ab396e4e06105788a
Jul 06 20:59:05.509163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.509133    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:05.509261 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.509198    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:05.509261 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.509229    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:05.715578 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.715543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerStarted","Data":"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"}
Jul 06 20:59:05.715784 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.715611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerStarted","Data":"699885102f214cace57241d985327bae66d6aa22d1d23f2ab396e4e06105788a"}
Jul 06 20:59:05.753866 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:05.753812    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podStartSLOduration=0.753793545 podStartE2EDuration="753.793545ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:05.749416746 +0000 UTC m=+2108.185069920" watchObservedRunningTime="2026-07-06 20:59:05.753793545 +0000 UTC m=+2108.189446722"
Jul 06 20:59:06.345704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:06.345670    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:06.350657 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:06.350631    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:06.721851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:06.721818    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:06.722989 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:06.722967    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:13.663334 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.663291    2571 patch_prober.go:28] interesting pod/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:59:13.663805 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.663351    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 20:59:13.762176 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.762139    2571 generic.go:356] "Generic (PLEG): container finished" podID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerID="6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229" exitCode=0
Jul 06 20:59:13.762349 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.762212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerDied","Data":"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"}
Jul 06 20:59:13.762750 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.762731    2571 scope.go:117] "RemoveContainer" containerID="6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"
Jul 06 20:59:13.763887 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.763849    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:13.764013 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.763916    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:13.764013 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:13.763950    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:14.773334 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:14.773289    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerStarted","Data":"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"}
Jul 06 20:59:15.127622 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:15.127584    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:15.127831 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:15.127810    2571 patch_prober.go:28] interesting pod/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:59:15.127878 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:15.127856    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 20:59:16.127703 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:16.127662    2571 patch_prober.go:28] interesting pod/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:59:16.128111 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:16.127744    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 20:59:17.127667 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:17.127633    2571 patch_prober.go:28] interesting pod/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:59:17.127857 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:17.127690    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 20:59:18.127537 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:18.127495    2571 patch_prober.go:28] interesting pod/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 20:59:18.127726 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:18.127548    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 20:59:19.131810 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:19.131777    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:19.132308 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:19.132155    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:19.132899 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:19.132883    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:22.763564 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:22.763515    2571 patch_prober.go:28] interesting pod/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:59:22.763993 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:22.763600    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:59:23.064763 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:23.064726    2571 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@9-23677-0.service\": RecentStats: unable to find data in memory cache]"
Jul 06 20:59:23.842015 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.841981    2571 generic.go:356] "Generic (PLEG): container finished" podID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerID="f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233" exitCode=0
Jul 06 20:59:23.842492 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.842054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerDied","Data":"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"}
Jul 06 20:59:23.842564 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.842521    2571 scope.go:117] "RemoveContainer" containerID="f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"
Jul 06 20:59:23.843664 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.843634    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:23.843724 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.843711    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:23.843765 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:23.843744    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:24.849764 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:24.849733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerStarted","Data":"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"}
Jul 06 20:59:25.345950 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:25.345910    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:25.346191 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:25.346169    2571 patch_prober.go:28] interesting pod/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 06 20:59:25.346238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:25.346220    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 06 20:59:26.345911 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:26.345874    2571 patch_prober.go:28] interesting pod/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 06 20:59:26.346319 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:26.345934    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 06 20:59:27.346161 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:27.346120    2571 patch_prober.go:28] interesting pod/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 06 20:59:27.346593 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:27.346182    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 06 20:59:27.818031 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:27.817982    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:59:27.818309 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:27.818281    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy" containerID="cri-o://5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223" gracePeriod=30
Jul 06 20:59:28.346077 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:28.346040    2571 patch_prober.go:28] interesting pod/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 06 20:59:28.346248 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:28.346099    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 06 20:59:29.349612 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:29.349573    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:29.350053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:29.349923    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:29.350662 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:29.350645    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:33.090389 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.090297    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:33.161135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161097    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c49xs\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161161    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161406    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161444 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161431    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161472    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:33.161663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161482    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161537    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161663 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161637    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert\") pod \"c57fbabf-7007-4d40-bba9-93f917efd41b\" (UID: \"c57fbabf-7007-4d40-bba9-93f917efd41b\") "
Jul 06 20:59:33.161870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161681    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:33.161870 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.161848    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:33.162093 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.162072    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.162162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.162099    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.162162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.162114    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.162162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.162079    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:59:33.162330 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.162283    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:33.163580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.163553    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs" (OuterVolumeSpecName: "kube-api-access-c49xs") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "kube-api-access-c49xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:33.163580 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.163566    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:59:33.163737 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.163651    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:33.163776 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.163746    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c57fbabf-7007-4d40-bba9-93f917efd41b" (UID: "c57fbabf-7007-4d40-bba9-93f917efd41b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:33.263162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263125    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.263162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263162    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c49xs\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-kube-api-access-c49xs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.263162 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263176    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.263518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263187    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.263518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263196    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c57fbabf-7007-4d40-bba9-93f917efd41b-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.263518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.263206    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c57fbabf-7007-4d40-bba9-93f917efd41b-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:33.925178 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.925148    2571 generic.go:356] "Generic (PLEG): container finished" podID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerID="5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223" exitCode=0
Jul 06 20:59:33.925401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.925197    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"
Jul 06 20:59:33.925401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.925211    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerDied","Data":"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"}
Jul 06 20:59:33.925401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.925258    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh" event={"ID":"c57fbabf-7007-4d40-bba9-93f917efd41b","Type":"ContainerDied","Data":"e05c06d21a5c55573200241c7c2c723cbef070e2ffbbb426b6c1d8558200a11a"}
Jul 06 20:59:33.925401 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.925280    2571 scope.go:117] "RemoveContainer" containerID="5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"
Jul 06 20:59:33.935998 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.935890    2571 scope.go:117] "RemoveContainer" containerID="6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"
Jul 06 20:59:33.945411 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.945390    2571 scope.go:117] "RemoveContainer" containerID="5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"
Jul 06 20:59:33.945779 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:33.945760    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223\": container with ID starting with 5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223 not found: ID does not exist" containerID="5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"
Jul 06 20:59:33.945863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.945790    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223"} err="failed to get container status \"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223\": rpc error: code = NotFound desc = could not find container \"5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223\": container with ID starting with 5a46b68e286e1e7a95b61d828ffcf2a136b8ab597796c8b4a098ad44af5fb223 not found: ID does not exist"
Jul 06 20:59:33.945863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.945809    2571 scope.go:117] "RemoveContainer" containerID="6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"
Jul 06 20:59:33.946130 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:33.946109    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229\": container with ID starting with 6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229 not found: ID does not exist" containerID="6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"
Jul 06 20:59:33.946174 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.946137    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229"} err="failed to get container status \"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229\": rpc error: code = NotFound desc = could not find container \"6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229\": container with ID starting with 6e6f812cf06f19f0cc752e05ebe27732573a47add7b42292be9493ff76f39229 not found: ID does not exist"
Jul 06 20:59:33.950866 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.950827    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:59:33.953476 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:33.953455    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c6b4b3-openshift-default-7f874c655f-c5zxh"]
Jul 06 20:59:34.175767 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:34.175679    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" path="/var/lib/kubelet/pods/c57fbabf-7007-4d40-bba9-93f917efd41b/volumes"
Jul 06 20:59:35.118199 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:35.118165    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:35.118457 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:35.118431    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy" containerID="cri-o://e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88" gracePeriod=30
Jul 06 20:59:36.012345 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012309    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 20:59:36.012786 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012771    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.012786 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012787    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.012863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012796    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.012863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012803    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.012863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012813    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:36.012863 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012820    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd28ba2f-07db-4082-822d-416ecd67d044" containerName="istio-proxy"
Jul 06 20:59:36.012987 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012882    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.012987 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.012891    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57fbabf-7007-4d40-bba9-93f917efd41b" containerName="istio-proxy"
Jul 06 20:59:36.017238 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.017217    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.020706 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.020674    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-544d30-openshift-default-dockercfg-sqqs8\""
Jul 06 20:59:36.034520 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.034495    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 20:59:36.091053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091175    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqhf\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091232 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.091517 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.091431    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192163 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqhf\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192446 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192806 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192621    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192806 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192672    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192919    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.192939 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.192921    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.193038 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.193020    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.194809 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.194774    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.194997 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.194981    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.204739 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.204712    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.205672 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.205656    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqhf\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf\") pod \"e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") " pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.328640 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.328546    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:36.489656 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.489623    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 20:59:36.492510 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:59:36.492462    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4643f1_d9bf_401f_8e98_715cfc81c601.slice/crio-9ac8db2502bdfbc59536437295244fb491a5ba99558b7b34ce4d1255eac0d078 WatchSource:0}: Error finding container 9ac8db2502bdfbc59536437295244fb491a5ba99558b7b34ce4d1255eac0d078: Status 404 returned error can't find the container with id 9ac8db2502bdfbc59536437295244fb491a5ba99558b7b34ce4d1255eac0d078
Jul 06 20:59:36.495907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.495873    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:36.496001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.495940    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:36.496001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.495966    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:36.949531 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.949487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerStarted","Data":"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"}
Jul 06 20:59:36.949756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.949541    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerStarted","Data":"9ac8db2502bdfbc59536437295244fb491a5ba99558b7b34ce4d1255eac0d078"}
Jul 06 20:59:36.979091 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:36.979035    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podStartSLOduration=1.979018374 podStartE2EDuration="1.979018374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:36.974012991 +0000 UTC m=+2139.409666170" watchObservedRunningTime="2026-07-06 20:59:36.979018374 +0000 UTC m=+2139.414671546"
Jul 06 20:59:37.329584 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:37.329477    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:37.334872 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:37.334844    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:37.956461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:37.956428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:37.957615 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:37.957593    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:40.385680 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.385599    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:40.536954 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.536916    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.536954 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.536966    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537031    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chf7t\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537113    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537146    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537213 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537192    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537509 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537259    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537509 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537282    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy\") pod \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\" (UID: \"58a7cb26-d284-44d9-8dbc-0ccba61f37d0\") "
Jul 06 20:59:40.537509 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537341    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:40.537509 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537420    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:40.537696 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537564    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:40.537696 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537657    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.537696 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537678    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.537696 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.537692    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.538109 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.538085    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:59:40.538328 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.538304    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:40.539430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.539409    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:40.539430 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.539420    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:59:40.539640 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.539622    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t" (OuterVolumeSpecName: "kube-api-access-chf7t") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "kube-api-access-chf7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:59:40.539694 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.539663    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58a7cb26-d284-44d9-8dbc-0ccba61f37d0" (UID: "58a7cb26-d284-44d9-8dbc-0ccba61f37d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638778    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638807    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638815    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638824    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chf7t\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-kube-api-access-chf7t\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638834    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.638868 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.638841    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58a7cb26-d284-44d9-8dbc-0ccba61f37d0-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 20:59:40.975096 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.975011    2571 generic.go:356] "Generic (PLEG): container finished" podID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerID="e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88" exitCode=0
Jul 06 20:59:40.975096 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.975055    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"
Jul 06 20:59:40.975296 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.975099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerDied","Data":"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"}
Jul 06 20:59:40.975296 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.975155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z" event={"ID":"58a7cb26-d284-44d9-8dbc-0ccba61f37d0","Type":"ContainerDied","Data":"699885102f214cace57241d985327bae66d6aa22d1d23f2ab396e4e06105788a"}
Jul 06 20:59:40.975296 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.975183    2571 scope.go:117] "RemoveContainer" containerID="e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"
Jul 06 20:59:40.985251 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.985233    2571 scope.go:117] "RemoveContainer" containerID="f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"
Jul 06 20:59:40.994443 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.994423    2571 scope.go:117] "RemoveContainer" containerID="e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"
Jul 06 20:59:40.994756 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:40.994734    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88\": container with ID starting with e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88 not found: ID does not exist" containerID="e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"
Jul 06 20:59:40.994806 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.994767    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88"} err="failed to get container status \"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88\": rpc error: code = NotFound desc = could not find container \"e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88\": container with ID starting with e5405629f108ab109c02908e60f3aefd2de4265d0f6720450eb4b5d6de270e88 not found: ID does not exist"
Jul 06 20:59:40.994806 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.994788    2571 scope.go:117] "RemoveContainer" containerID="f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"
Jul 06 20:59:40.995070 ip-10-0-138-229 kubenswrapper[2571]: E0706 20:59:40.995051    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233\": container with ID starting with f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233 not found: ID does not exist" containerID="f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"
Jul 06 20:59:40.995130 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:40.995075    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233"} err="failed to get container status \"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233\": rpc error: code = NotFound desc = could not find container \"f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233\": container with ID starting with f50e01881ce5003c1f3e23668e226792736592be98f58ac517c9fa4db403a233 not found: ID does not exist"
Jul 06 20:59:41.000849 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:41.000177    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:41.009743 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:41.009711    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-275fd7-openshift-default-7fbcfbdb4c-p289z"]
Jul 06 20:59:42.176149 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:42.176111    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" path="/var/lib/kubelet/pods/58a7cb26-d284-44d9-8dbc-0ccba61f37d0/volumes"
Jul 06 20:59:44.354851 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.354814    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 20:59:44.355247 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.355210    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 20:59:44.355247 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.355222    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 20:59:44.355326 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.355300    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 20:59:44.355326 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.355308    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 20:59:44.359836 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.359816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.363424 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.363390    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cd7c86-openshift-default-dockercfg-6nrc8\""
Jul 06 20:59:44.430518 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.430476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 20:59:44.477001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.476966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477001 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477205 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsbbp\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477205 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477205 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477176    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477309 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477309 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477405 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.477405 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.477385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.578679 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.578644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.578852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.578707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.578852 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.578828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.578922 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.578908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.578968 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.578945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579012 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579049 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579101 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579071    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsbbp\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579157 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579109    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579157 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579264 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579172    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579322 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579260    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579416 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579385    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.579704 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.579681    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.581308 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.581287    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.581650 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.581629    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.594434 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.594399    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.594827 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.594808    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsbbp\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp\") pod \"e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") " pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.670545 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.670505    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:44.856075 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.856037    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 20:59:44.860757 ip-10-0-138-229 kubenswrapper[2571]: W0706 20:59:44.860720    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133d6ce9_1dcb_472a_a539_7a049c0137b5.slice/crio-ec678f0283efcf0b86c0e0ea52158426927735cdaf79572d76875a516c440108 WatchSource:0}: Error finding container ec678f0283efcf0b86c0e0ea52158426927735cdaf79572d76875a516c440108: Status 404 returned error can't find the container with id ec678f0283efcf0b86c0e0ea52158426927735cdaf79572d76875a516c440108
Jul 06 20:59:44.863348 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.863316    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:44.863462 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.863422    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:44.863542 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:44.863464    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:45.001915 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:45.001876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerStarted","Data":"2c29211a82a4a4a909f8108d350a61e13d147a0b3f73bbfbcb3f510fa7029b45"}
Jul 06 20:59:45.002093 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:45.001938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerStarted","Data":"ec678f0283efcf0b86c0e0ea52158426927735cdaf79572d76875a516c440108"}
Jul 06 20:59:45.036314 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:45.036260    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podStartSLOduration=1.036242034 podStartE2EDuration="1.036242034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:59:45.034753308 +0000 UTC m=+2147.470406488" watchObservedRunningTime="2026-07-06 20:59:45.036242034 +0000 UTC m=+2147.471895212"
Jul 06 20:59:45.670917 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:45.670881    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:45.691562 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:45.691529    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:46.007777 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:46.007698    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:46.008890 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:46.008874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 20:59:52.958204 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:52.958162    2571 patch_prober.go:28] interesting pod/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 20:59:52.958639 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:52.958233    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 20:59:53.051397 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.051296    2571 generic.go:356] "Generic (PLEG): container finished" podID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerID="22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a" exitCode=0
Jul 06 20:59:53.051575 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.051380    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerDied","Data":"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"}
Jul 06 20:59:53.051907 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.051889    2571 scope.go:117] "RemoveContainer" containerID="22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"
Jul 06 20:59:53.053171 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.053141    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:53.053252 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.053226    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:53.053289 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:53.053261    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 20:59:54.058756 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:54.058724    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerStarted","Data":"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"}
Jul 06 20:59:54.328947 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:54.328921    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:54.329053 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:54.329024    2571 patch_prober.go:28] interesting pod/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 20:59:54.329099 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:54.329056    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 20:59:55.329740 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:55.329701    2571 patch_prober.go:28] interesting pod/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 20:59:55.330135 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:55.329756    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 20:59:56.329719 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:56.329683    2571 patch_prober.go:28] interesting pod/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 20:59:56.329896 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:56.329750    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 20:59:57.329461 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:57.329416    2571 patch_prober.go:28] interesting pod/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 20:59:57.329642 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:57.329491    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 20:59:58.333940 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:58.333910    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:58.334332 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:58.334309    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 20:59:58.335105 ip-10-0-138-229 kubenswrapper[2571]: I0706 20:59:58.335089    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 21:00:00.105546 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.105514    2571 generic.go:356] "Generic (PLEG): container finished" podID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerID="2c29211a82a4a4a909f8108d350a61e13d147a0b3f73bbfbcb3f510fa7029b45" exitCode=0
Jul 06 21:00:00.105987 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.105594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerDied","Data":"2c29211a82a4a4a909f8108d350a61e13d147a0b3f73bbfbcb3f510fa7029b45"}
Jul 06 21:00:00.106138 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.106123    2571 scope.go:117] "RemoveContainer" containerID="2c29211a82a4a4a909f8108d350a61e13d147a0b3f73bbfbcb3f510fa7029b45"
Jul 06 21:00:00.107047 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.107024    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 21:00:00.107099 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.107084    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 21:00:00.107134 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:00.107117    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 21:00:01.007921 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:01.007881    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:00:01.113849 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:01.113811    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerStarted","Data":"1960564b23517075c97ed58c7468e6b905f71cc846247e6503b8215e91815073"}
Jul 06 21:00:01.672741 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:01.672703    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:00:01.673116 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:01.673091    2571 patch_prober.go:28] interesting pod/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 21:00:01.673278 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:01.673255    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 21:00:02.671575 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:02.671533    2571 patch_prober.go:28] interesting pod/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 21:00:02.672190 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:02.672155    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 21:00:03.671879 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:03.671835    2571 patch_prober.go:28] interesting pod/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 21:00:03.672634 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:03.672598    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 21:00:04.671301 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:04.671247    2571 patch_prober.go:28] interesting pod/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 21:00:04.671544 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:04.671325    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 21:00:05.675114 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:05.675084    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:00:05.675613 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:05.675428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:00:05.676089 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:00:05.676071    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:05:36.065752 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:36.065712    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 21:05:36.066236 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:36.065921    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy" containerID="cri-o://f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42" gracePeriod=30
Jul 06 21:05:41.335738 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.335652    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 21:05:41.495503 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495455    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495503 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495511    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495771 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495771 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495771 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495771 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495711    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.495771 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xqhf\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.496036 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495804    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.496036 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495837    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data\") pod \"ff4643f1-d9bf-401f-8e98-715cfc81c601\" (UID: \"ff4643f1-d9bf-401f-8e98-715cfc81c601\") "
Jul 06 21:05:41.496036 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495891    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:41.496036 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495929    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:41.496036 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.495991    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:05:41.496298 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.496195    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:41.496298 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.496263    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.496298 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.496283    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff4643f1-d9bf-401f-8e98-715cfc81c601-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.496298 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.496297    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.497026 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.496995    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:41.497943 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.497921    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:41.498196 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.498177    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:05:41.498440 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.498422    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf" (OuterVolumeSpecName: "kube-api-access-2xqhf") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "kube-api-access-2xqhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:05:41.498508 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.498434    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff4643f1-d9bf-401f-8e98-715cfc81c601" (UID: "ff4643f1-d9bf-401f-8e98-715cfc81c601"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597287    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xqhf\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-kube-api-access-2xqhf\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597323    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597332    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597340    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597348    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:41.597430 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:41.597386    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff4643f1-d9bf-401f-8e98-715cfc81c601-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:42.137385 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.137322    2571 generic.go:356] "Generic (PLEG): container finished" podID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerID="f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42" exitCode=0
Jul 06 21:05:42.137577 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.137400    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"
Jul 06 21:05:42.137577 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.137415    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerDied","Data":"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"}
Jul 06 21:05:42.137577 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.137475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs" event={"ID":"ff4643f1-d9bf-401f-8e98-715cfc81c601","Type":"ContainerDied","Data":"9ac8db2502bdfbc59536437295244fb491a5ba99558b7b34ce4d1255eac0d078"}
Jul 06 21:05:42.137577 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.137499    2571 scope.go:117] "RemoveContainer" containerID="f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"
Jul 06 21:05:42.151817 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.151781    2571 scope.go:117] "RemoveContainer" containerID="22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"
Jul 06 21:05:42.162707 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.162680    2571 scope.go:117] "RemoveContainer" containerID="f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"
Jul 06 21:05:42.163079 ip-10-0-138-229 kubenswrapper[2571]: E0706 21:05:42.163058    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42\": container with ID starting with f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42 not found: ID does not exist" containerID="f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"
Jul 06 21:05:42.163143 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.163090    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42"} err="failed to get container status \"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42\": rpc error: code = NotFound desc = could not find container \"f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42\": container with ID starting with f3bebd79f18423cb9fa40f15d80e3e74f3349ad42c4202d414274f010532bb42 not found: ID does not exist"
Jul 06 21:05:42.163143 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.163111    2571 scope.go:117] "RemoveContainer" containerID="22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"
Jul 06 21:05:42.163402 ip-10-0-138-229 kubenswrapper[2571]: E0706 21:05:42.163377    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a\": container with ID starting with 22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a not found: ID does not exist" containerID="22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"
Jul 06 21:05:42.163495 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.163412    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a"} err="failed to get container status \"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a\": rpc error: code = NotFound desc = could not find container \"22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a\": container with ID starting with 22e2532ff80d3ecae0a590cfd95ad4dfb96bb16fc243cd8fe205241f5eef668a not found: ID does not exist"
Jul 06 21:05:42.183699 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.183668    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 21:05:42.183699 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:42.183708    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-544d30-openshift-default-646c6545bc-46qjs"]
Jul 06 21:05:43.964908 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:43.964866    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 21:05:43.965452 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:43.965130    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy" containerID="cri-o://1960564b23517075c97ed58c7468e6b905f71cc846247e6503b8215e91815073" gracePeriod=30
Jul 06 21:05:44.176694 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:44.176660    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" path="/var/lib/kubelet/pods/ff4643f1-d9bf-401f-8e98-715cfc81c601/volumes"
Jul 06 21:05:49.182587 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.182554    2571 generic.go:356] "Generic (PLEG): container finished" podID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerID="1960564b23517075c97ed58c7468e6b905f71cc846247e6503b8215e91815073" exitCode=0
Jul 06 21:05:49.182978 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.182643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerDied","Data":"1960564b23517075c97ed58c7468e6b905f71cc846247e6503b8215e91815073"}
Jul 06 21:05:49.182978 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.182773    2571 scope.go:117] "RemoveContainer" containerID="2c29211a82a4a4a909f8108d350a61e13d147a0b3f73bbfbcb3f510fa7029b45"
Jul 06 21:05:49.237782 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.237684    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:05:49.277580 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277547    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.277786 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277600    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.277786 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277618    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.277786 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277683    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.277786 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277722    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.277786 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277781    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.278078 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277817    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsbbp\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.278078 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277854    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.278078 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277892    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket\") pod \"133d6ce9-1dcb-472a-a539-7a049c0137b5\" (UID: \"133d6ce9-1dcb-472a-a539-7a049c0137b5\") "
Jul 06 21:05:49.278235 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277849    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:49.278235 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.277938    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:49.278235 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.278185    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:05:49.278464 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.278424    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:49.278533 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.278505    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:49.280300 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.280256    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:05:49.280575 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.280540    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:05:49.280678 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.280599    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:05:49.280678 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.280602    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp" (OuterVolumeSpecName: "kube-api-access-bsbbp") pod "133d6ce9-1dcb-472a-a539-7a049c0137b5" (UID: "133d6ce9-1dcb-472a-a539-7a049c0137b5"). InnerVolumeSpecName "kube-api-access-bsbbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:05:49.379171 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379130    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/133d6ce9-1dcb-472a-a539-7a049c0137b5-istiod-ca-cert\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379171 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379161    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-credential-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379171 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379172    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-socket\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379171 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379181    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-data\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379477 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379189    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-workload-certs\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379477 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379197    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-podinfo\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379477 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379204    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-envoy\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379477 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379212    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-istio-token\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.379477 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.379220    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsbbp\" (UniqueName: \"kubernetes.io/projected/133d6ce9-1dcb-472a-a539-7a049c0137b5-kube-api-access-bsbbp\") on node \"ip-10-0-138-229.ec2.internal\" DevicePath \"\""
Jul 06 21:05:49.512708 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.512635    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ht86g_3d4e80b1-1719-4653-8eaa-6ae3a6b54a62/manager/0.log"
Jul 06 21:05:49.637155 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:49.637127    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jc4gj_cabe8f1a-db88-4f81-8d90-c5374e372688/manager/0.log"
Jul 06 21:05:50.190667 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.190634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t" event={"ID":"133d6ce9-1dcb-472a-a539-7a049c0137b5","Type":"ContainerDied","Data":"ec678f0283efcf0b86c0e0ea52158426927735cdaf79572d76875a516c440108"}
Jul 06 21:05:50.191135 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.190690    2571 scope.go:117] "RemoveContainer" containerID="1960564b23517075c97ed58c7468e6b905f71cc846247e6503b8215e91815073"
Jul 06 21:05:50.191135 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.190649    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"
Jul 06 21:05:50.211155 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.211117    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 21:05:50.215684 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.215650    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cd7c86-openshift-default-679444d99-jnc2t"]
Jul 06 21:05:50.268014 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.267989    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-p4pj5_ed5286f2-fb24-4eab-bd91-0100dbd64365/server/0.log"
Jul 06 21:05:50.412880 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.412849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r65z8_4d90bfa7-03b6-4d72-9837-4193530b77aa/manager/0.log"
Jul 06 21:05:50.529241 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.529162    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656f947554-2rv94_5ff43133-2a17-4a24-bf82-132cef61afd5/copy-manifests/0.log"
Jul 06 21:05:50.540072 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:50.540047    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656f947554-2rv94_5ff43133-2a17-4a24-bf82-132cef61afd5/manager/0.log"
Jul 06 21:05:51.719219 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.719190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/util/0.log"
Jul 06 21:05:51.728812 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.728788    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/pull/0.log"
Jul 06 21:05:51.736136 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.736112    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/extract/0.log"
Jul 06 21:05:51.857954 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.857916    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/pull/0.log"
Jul 06 21:05:51.866250 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.866229    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/extract/0.log"
Jul 06 21:05:51.873710 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.873687    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/util/0.log"
Jul 06 21:05:51.991028 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:51.990956    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/extract/0.log"
Jul 06 21:05:52.000908 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.000884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/util/0.log"
Jul 06 21:05:52.014369 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.014340    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/pull/0.log"
Jul 06 21:05:52.152958 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.152929    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/util/0.log"
Jul 06 21:05:52.160725 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.160698    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/pull/0.log"
Jul 06 21:05:52.168008 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.167983    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/extract/0.log"
Jul 06 21:05:52.175199 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:52.175168    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" path="/var/lib/kubelet/pods/133d6ce9-1dcb-472a-a539-7a049c0137b5/volumes"
Jul 06 21:05:53.206295 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:53.206260    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j29n9_32dbb76c-b195-4832-a078-3fee234b01a5/manager/0.log"
Jul 06 21:05:53.630969 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:53.630940    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pvc7t_24203ffa-c913-4942-9e1d-7467025ffd90/istio-proxy/0.log"
Jul 06 21:05:53.753825 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:53.753797    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5vvx9_05603ad7-9c84-4e48-b3d9-06cceb92d13e/discovery/0.log"
Jul 06 21:05:53.874057 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:53.874027    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d4f4589-bt6gs_66326720-8f75-447a-bdce-054c90ee031e/kube-auth-proxy/0.log"
Jul 06 21:05:54.105698 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:54.105616    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/1.log"
Jul 06 21:05:54.494218 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:54.494190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8f695bc9-s6z6g_c462e4a5-cd4e-4c62-9806-9b1f6af5435b/router/0.log"
Jul 06 21:05:54.994414 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:54.994390    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-w5kh4_932f270a-c8b7-4a1a-aed5-31af7973194e/main/0.log"
Jul 06 21:05:55.246062 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:05:55.245975    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2c2b2_9a9cd4c5-a73c-4e0c-a759-5232757ac707/main/0.log"
Jul 06 21:06:02.868296 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:02.868262    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zjskn_88356ccd-ae8a-43d7-b046-5d0612d50d08/global-pull-secret-syncer/0.log"
Jul 06 21:06:02.982062 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:02.982011    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rnj5t_698c21fe-d480-4a3d-b295-026556aca1f0/konnectivity-agent/0.log"
Jul 06 21:06:03.089407 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:03.089375    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-229.ec2.internal_439c997d82aa77501d70907300d26dc7/haproxy/0.log"
Jul 06 21:06:07.176402 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.176370    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/extract/0.log"
Jul 06 21:06:07.221135 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.221108    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/util/0.log"
Jul 06 21:06:07.266550 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.266520    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n8lns_a0eea0a3-184e-43b3-ab67-7ac81aaf9d10/pull/0.log"
Jul 06 21:06:07.302701 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.302674    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/extract/0.log"
Jul 06 21:06:07.361739 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.361706    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/util/0.log"
Jul 06 21:06:07.384756 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.384724    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cl2vm_f5377c69-d04a-40fc-9622-73a402e22532/pull/0.log"
Jul 06 21:06:07.436420 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.436311    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/extract/0.log"
Jul 06 21:06:07.472042 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.472010    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/util/0.log"
Jul 06 21:06:07.511304 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.511272    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jrcqm_08d6599f-1a69-4640-b2b4-322dc77c0e5c/pull/0.log"
Jul 06 21:06:07.555332 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.555305    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/extract/0.log"
Jul 06 21:06:07.585421 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.585396    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/util/0.log"
Jul 06 21:06:07.628575 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:07.628549    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldgb7_80504171-1986-45e6-a1a4-add97713a98c/pull/0.log"
Jul 06 21:06:08.960864 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:08.960832    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j29n9_32dbb76c-b195-4832-a078-3fee234b01a5/manager/0.log"
Jul 06 21:06:10.987009 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:10.986943    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-hlsz7_6c996b68-2495-4b5a-8a1b-e3046d5023ca/cluster-monitoring-operator/0.log"
Jul 06 21:06:11.653452 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:11.653426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r44kj_b92bd071-ba1d-46c9-9abb-3a63bff0735d/node-exporter/0.log"
Jul 06 21:06:11.730251 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:11.730219    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r44kj_b92bd071-ba1d-46c9-9abb-3a63bff0735d/kube-rbac-proxy/0.log"
Jul 06 21:06:11.845427 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:11.845400    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r44kj_b92bd071-ba1d-46c9-9abb-3a63bff0735d/init-textfile/0.log"
Jul 06 21:06:11.915890 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:11.915815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9stn2_9925d557-aaad-4801-b02e-84d07116e8b4/kube-rbac-proxy-main/0.log"
Jul 06 21:06:11.963977 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:11.963947    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9stn2_9925d557-aaad-4801-b02e-84d07116e8b4/kube-rbac-proxy-self/0.log"
Jul 06 21:06:12.043313 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.043279    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9stn2_9925d557-aaad-4801-b02e-84d07116e8b4/openshift-state-metrics/0.log"
Jul 06 21:06:12.412690 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.412655    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-28lsl_7dd8f243-603e-42f8-a5c8-00af5216009c/prometheus-operator-admission-webhook/0.log"
Jul 06 21:06:12.449676 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.449643    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-965f88b65-tb5ns_d8148107-369a-4b22-bed8-36d61cfe2434/telemeter-client/0.log"
Jul 06 21:06:12.502605 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.502576    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-965f88b65-tb5ns_d8148107-369a-4b22-bed8-36d61cfe2434/reload/0.log"
Jul 06 21:06:12.543538 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.543501    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-965f88b65-tb5ns_d8148107-369a-4b22-bed8-36d61cfe2434/kube-rbac-proxy/0.log"
Jul 06 21:06:12.592658 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.592629    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/thanos-query/0.log"
Jul 06 21:06:12.622206 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.622174    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/kube-rbac-proxy-web/0.log"
Jul 06 21:06:12.652388 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.652344    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/kube-rbac-proxy/0.log"
Jul 06 21:06:12.694130 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.694037    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/prom-label-proxy/0.log"
Jul 06 21:06:12.727280 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.727255    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/kube-rbac-proxy-rules/0.log"
Jul 06 21:06:12.761466 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.761437    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-579dc8fb8-l7bq6_1bca3da4-4f8c-488f-8ff3-1da04e5d2e83/kube-rbac-proxy-metrics/0.log"
Jul 06 21:06:12.985473 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985380    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"]
Jul 06 21:06:12.985837 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985823    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985838    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985847    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985852    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985865    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985871    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a7cb26-d284-44d9-8dbc-0ccba61f37d0" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985879    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.985886 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985885    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.986122 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985893    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy"
Jul 06 21:06:12.986122 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985899    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy"
Jul 06 21:06:12.986122 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985958    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.986122 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985964    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff4643f1-d9bf-401f-8e98-715cfc81c601" containerName="istio-proxy"
Jul 06 21:06:12.986122 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.985972    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="133d6ce9-1dcb-472a-a539-7a049c0137b5" containerName="istio-proxy"
Jul 06 21:06:12.989230 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.989209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:12.992219 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.992179    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9hcgk\"/\"openshift-service-ca.crt\""
Jul 06 21:06:12.993153 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.993133    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9hcgk\"/\"kube-root-ca.crt\""
Jul 06 21:06:12.993279 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:12.993137    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9hcgk\"/\"default-dockercfg-mnbcs\""
Jul 06 21:06:13.002464 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.002432    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"]
Jul 06 21:06:13.113119 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.113079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-proc\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.113119 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.113127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-lib-modules\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.113661 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.113228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-podres\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.113661 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.113261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crlxv\" (UniqueName: \"kubernetes.io/projected/1e298473-4b58-4614-810e-ad76b67fc2eb-kube-api-access-crlxv\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.113661 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.113310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-sys\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214409 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-proc\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214409 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-lib-modules\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214639 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214461    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-podres\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214639 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214472    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-proc\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214639 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crlxv\" (UniqueName: \"kubernetes.io/projected/1e298473-4b58-4614-810e-ad76b67fc2eb-kube-api-access-crlxv\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214639 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-sys\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214776 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214670    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-sys\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214776 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214770    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-lib-modules\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.214850 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.214811    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e298473-4b58-4614-810e-ad76b67fc2eb-podres\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.224648 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.224609    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crlxv\" (UniqueName: \"kubernetes.io/projected/1e298473-4b58-4614-810e-ad76b67fc2eb-kube-api-access-crlxv\") pod \"perf-node-gather-daemonset-v2q4p\" (UID: \"1e298473-4b58-4614-810e-ad76b67fc2eb\") " pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.303505 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.303412    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:13.459785 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:13.459753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"]
Jul 06 21:06:13.461814 ip-10-0-138-229 kubenswrapper[2571]: W0706 21:06:13.461773    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1e298473_4b58_4614_810e_ad76b67fc2eb.slice/crio-efeb16fe84d64f90420f3b32503a10a5578ffff1ec38d7dfacff03b88dfdc7d1 WatchSource:0}: Error finding container efeb16fe84d64f90420f3b32503a10a5578ffff1ec38d7dfacff03b88dfdc7d1: Status 404 returned error can't find the container with id efeb16fe84d64f90420f3b32503a10a5578ffff1ec38d7dfacff03b88dfdc7d1
Jul 06 21:06:14.038200 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:14.038176    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-7vwcx_9a96b41f-e020-4fa2-b6b8-a07ae09d2124/networking-console-plugin/0.log"
Jul 06 21:06:14.335524 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:14.335431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p" event={"ID":"1e298473-4b58-4614-810e-ad76b67fc2eb","Type":"ContainerStarted","Data":"3c07dd41f54cec99d032a10fcc0729788b178e782efdb56150800150222693b5"}
Jul 06 21:06:14.335524 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:14.335490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p" event={"ID":"1e298473-4b58-4614-810e-ad76b67fc2eb","Type":"ContainerStarted","Data":"efeb16fe84d64f90420f3b32503a10a5578ffff1ec38d7dfacff03b88dfdc7d1"}
Jul 06 21:06:14.335923 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:14.335558    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:14.359007 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:14.358953    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p" podStartSLOduration=2.358930209 podStartE2EDuration="2.358930209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:06:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:06:14.356333191 +0000 UTC m=+2536.791986370" watchObservedRunningTime="2026-07-06 21:06:14.358930209 +0000 UTC m=+2536.794583389"
Jul 06 21:06:15.354776 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:15.354743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-trs6t_30eeaa52-243c-4b47-8d1f-447e61ecd9f0/download-server/0.log"
Jul 06 21:06:17.221761 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:17.221729    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-776j4_a6b28010-18c1-4f51-80d8-f0c5383f791c/dns/0.log"
Jul 06 21:06:17.381657 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:17.381602    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-776j4_a6b28010-18c1-4f51-80d8-f0c5383f791c/kube-rbac-proxy/0.log"
Jul 06 21:06:17.634241 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:17.634217    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzr7s_e0062ec7-3059-4fbf-81d7-446b387d34e3/dns-node-resolver/0.log"
Jul 06 21:06:18.456857 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:18.456815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65cbbfc584-hgdtq_a72aa4ae-5eff-4e76-a8f0-f6d3043816eb/registry/0.log"
Jul 06 21:06:18.566513 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:18.566476    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sx97n_6cf26b5d-764d-43a8-941b-eab56add0bc1/node-ca/0.log"
Jul 06 21:06:19.639894 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:19.639865    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pvc7t_24203ffa-c913-4942-9e1d-7467025ffd90/istio-proxy/0.log"
Jul 06 21:06:19.762373 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:19.762338    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5vvx9_05603ad7-9c84-4e48-b3d9-06cceb92d13e/discovery/0.log"
Jul 06 21:06:19.788141 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:19.788105    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d4f4589-bt6gs_66326720-8f75-447a-bdce-054c90ee031e/kube-auth-proxy/0.log"
Jul 06 21:06:19.873021 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:19.872993    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/0.log"
Jul 06 21:06:19.898169 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:19.898078    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/1.log"
Jul 06 21:06:20.157960 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:20.157859    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8f695bc9-s6z6g_c462e4a5-cd4e-4c62-9806-9b1f6af5435b/router/0.log"
Jul 06 21:06:20.352318 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:20.352293    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9hcgk/perf-node-gather-daemonset-v2q4p"
Jul 06 21:06:20.983524 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:20.983495    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcnk6_2efabbef-7590-4061-b1d8-cbc835369e8c/serve-healthcheck-canary/0.log"
Jul 06 21:06:21.611663 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:21.611629    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-97vdg_2e38a63b-8a3c-48be-80f6-de0d3f154f96/insights-operator/0.log"
Jul 06 21:06:21.611876 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:21.611860    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-97vdg_2e38a63b-8a3c-48be-80f6-de0d3f154f96/insights-operator/1.log"
Jul 06 21:06:21.770470 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:21.770437    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pc9qm_0005742e-a52a-4a43-8919-32878acc6367/kube-rbac-proxy/0.log"
Jul 06 21:06:21.800172 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:21.800140    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pc9qm_0005742e-a52a-4a43-8919-32878acc6367/exporter/0.log"
Jul 06 21:06:21.836330 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:21.836295    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pc9qm_0005742e-a52a-4a43-8919-32878acc6367/extractor/0.log"
Jul 06 21:06:24.031387 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.031336    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pvc7t_24203ffa-c913-4942-9e1d-7467025ffd90/istio-proxy/0.log"
Jul 06 21:06:24.143063 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.143025    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5vvx9_05603ad7-9c84-4e48-b3d9-06cceb92d13e/discovery/0.log"
Jul 06 21:06:24.154139 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.154114    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d4f4589-bt6gs_66326720-8f75-447a-bdce-054c90ee031e/kube-auth-proxy/0.log"
Jul 06 21:06:24.201400 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.201369    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/0.log"
Jul 06 21:06:24.229912 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.229872    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/1.log"
Jul 06 21:06:24.310815 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.310729    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8f695bc9-s6z6g_c462e4a5-cd4e-4c62-9806-9b1f6af5435b/router/0.log"
Jul 06 21:06:24.786009 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.785977    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ht86g_3d4e80b1-1719-4653-8eaa-6ae3a6b54a62/manager/0.log"
Jul 06 21:06:24.928565 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:24.928535    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jc4gj_cabe8f1a-db88-4f81-8d90-c5374e372688/manager/0.log"
Jul 06 21:06:25.159694 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.159662    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-p4pj5_ed5286f2-fb24-4eab-bd91-0100dbd64365/server/0.log"
Jul 06 21:06:25.228347 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.228317    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-r65z8_4d90bfa7-03b6-4d72-9837-4193530b77aa/manager/0.log"
Jul 06 21:06:25.258939 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.258908    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656f947554-2rv94_5ff43133-2a17-4a24-bf82-132cef61afd5/manager/0.log"
Jul 06 21:06:25.309052 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.309020    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656f947554-2rv94_5ff43133-2a17-4a24-bf82-132cef61afd5/copy-manifests/0.log"
Jul 06 21:06:25.562573 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.562489    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4pvc7t_24203ffa-c913-4942-9e1d-7467025ffd90/istio-proxy/0.log"
Jul 06 21:06:25.678918 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.678889    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5vvx9_05603ad7-9c84-4e48-b3d9-06cceb92d13e/discovery/0.log"
Jul 06 21:06:25.693043 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.693019    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d4f4589-bt6gs_66326720-8f75-447a-bdce-054c90ee031e/kube-auth-proxy/0.log"
Jul 06 21:06:25.739768 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.739733    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/0.log"
Jul 06 21:06:25.768035 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.767997    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8gg55_4b01aa22-48d8-4ace-949c-424cfe68830d/istio-proxy/1.log"
Jul 06 21:06:25.850068 ip-10-0-138-229 kubenswrapper[2571]: I0706 21:06:25.849984    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c8f695bc9-s6z6g_c462e4a5-cd4e-4c62-9806-9b1f6af5435b/router/0.log"