Jul 20 18:58:29.635417 ip-10-0-135-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 18:58:29.635427 ip-10-0-135-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 18:58:29.635435 ip-10-0-135-117 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 18:58:29.635725 ip-10-0-135-117 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 18:58:39.811003 ip-10-0-135-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 18:58:39.811024 ip-10-0-135-117 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 78616d7f6ac24c2d806a7a97bf178ee3 --
Jul 20 19:00:37.481537 ip-10-0-135-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.842592    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849001    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849016    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849023    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849027    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849031    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849035    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849040    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.850835 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849044    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849047    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849051    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849055    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849058    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849062    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849065    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849070    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849074    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849077    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849081    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849085    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849091    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849097    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849103    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849108    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849112    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849117    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849122    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.852633 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849126    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849130    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849134    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849138    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849141    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849145    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849149    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849153    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849159    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849163    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849167    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849170    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849174    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849178    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849181    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849185    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849189    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849193    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849196    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849200    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.853371 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849203    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849207    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849211    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849214    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849218    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849222    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849225    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849229    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849232    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849236    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849240    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849244    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849248    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849252    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849255    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849259    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849262    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849266    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849269    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.855701 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849273    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849277    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849297    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849301    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849305    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849309    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849313    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849317    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849321    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849326    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849330    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849333    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849338    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849342    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849345    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849349    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849352    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849356    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849360    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849364    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.857788 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849367    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849371    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849375    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849378    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849383    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849387    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849391    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849394    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849398    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849401    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849405    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849409    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849413    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.849417    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850404    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850413    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850416    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850420    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850424    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850429    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.860059 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850433    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850437    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850440    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850445    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850449    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850454    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850458    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850461    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850465    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850469    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850473    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850477    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850481    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850485    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850489    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850493    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850496    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850500    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850504    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850508    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.860860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850512    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850516    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850519    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850523    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850527    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850531    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850535    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850539    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850543    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850547    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850551    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850555    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850561    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850565    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850569    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850573    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850578    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850583    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850586    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.863054 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850590    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850594    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850597    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850601    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850605    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850609    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850612    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850616    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850619    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850623    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850626    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850630    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850635    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850639    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850643    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850647    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850651    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850657    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850662    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850666    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.864752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850670    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850675    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850679    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850683    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850687    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850692    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850697    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850700    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850704    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850708    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850712    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850716    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850720    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850724    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850728    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850735    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850740    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850744    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850748    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.865693 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850752    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850756    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850760    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850763    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850767    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850770    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850774    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850777    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850781    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850785    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850788    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850792    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850796    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850799    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.850803    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851326    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851333    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851338    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851344    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.866551 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851348    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851352    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851357    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851364    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851368    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851372    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851375    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851379    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851383    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851387    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851390    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851394    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851398    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851402    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851405    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851409    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851413    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851416    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851420    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851423    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.867214 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851427    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851433    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851438    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851442    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851446    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851450    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851454    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851458    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851462    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851466    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851470    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851473    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851477    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851482    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851487    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851491    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851497    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851501    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851505    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.867860 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851509    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851512    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851516    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851519    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851523    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851527    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851531    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851534    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851538    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851541    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851545    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851549    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851553    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851556    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851560    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851565    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851568    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851572    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851576    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851579    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.868490 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851583    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851586    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851590    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851593    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851597    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851601    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851604    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851608    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851613    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851620    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851624    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851627    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851631    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851635    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851638    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851641    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851645    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851649    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851653    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851656    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.869116 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851662    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851666    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851670    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851675    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851679    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851683    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851686    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851689    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851693    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851697    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851700    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851704    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851708    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851711    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851715    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.851718    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851799    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851807    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851816    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851822    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851829    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:00:37.869741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851835    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851841    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851847    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851851    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851855    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851860    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851865    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851869    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851873    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851877    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851882    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851886    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851890    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851895    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851899    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851903    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851907    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851913    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851918    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851922    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851926    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851931    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851936    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851940    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:00:37.870402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851944    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851949    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851953    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851958    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851963    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851967    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851971    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851980    2563 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851986    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851992    2563 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.851997    2563 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852001    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852005    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852010    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852015    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852020    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852024    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852029    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852033    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852037    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852041    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852045    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852049    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852053    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852057    2563 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:00:37.871018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852062    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852067    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852071    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852075    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852079    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852084    2563 flags.go:64] FLAG: --help="false"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852087    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852092    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852096    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852100    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852104    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852109    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852113    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852117    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852122    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852128    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852133    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852137    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852141    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852146    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852150    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852154    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852158    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852161    2563 flags.go:64] FLAG: --lock-file=""
Jul 20 19:00:37.871857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852166    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852170    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852174    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852180    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852184    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852188    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852192    2563 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852196    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852200    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852204    2563 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852208    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852213    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852218    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852223    2563 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852227    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852232    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852236    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852240    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852244    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852250    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852254    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852263    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852268    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852274    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:00:37.876043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852278    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852297    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852304    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852308    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852312    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852317    2563 flags.go:64] FLAG: --port="10250"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852321    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852325    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02efb11e452b5fd79"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852330    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852334    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852338    2563 flags.go:64] FLAG: --register-node="true"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852342    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852348    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852351    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852356    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852360    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852365    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852369    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852374    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852378    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852382    2563 flags.go:64] FLAG: --runonce="false"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852386    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852390    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852394    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852398    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:00:37.876878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852402    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852406    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852410    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852415    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852419    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852425    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852429    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852435    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852439    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852454    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852458    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852466    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852469    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852474    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852479    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852483    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852487    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852491    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852496    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852500    2563 flags.go:64] FLAG: --v="2"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852505    2563 flags.go:64] FLAG: --version="false"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852510    2563 flags.go:64] FLAG: --vmodule=""
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852515    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.852520    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852697    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.886107 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852704    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852708    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852712    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852716    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852720    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852724    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852728    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852731    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852735    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852739    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852743    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852746    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852752    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852756    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852760    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852764    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852768    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852772    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852776    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852780    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.886903 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852784    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852787    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852790    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852794    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852798    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852802    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852805    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852809    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852813    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852816    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852820    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852824    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852828    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852832    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852836    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852840    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852843    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852847    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852851    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.887502 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852855    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852861    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852866    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852870    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852874    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852880    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852885    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852891    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852895    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852900    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852904    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852915    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852920    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852924    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852928    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852932    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852936    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852940    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852944    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.888206 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852948    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852951    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852955    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852959    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852963    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852967    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852972    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852975    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852979    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852984    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852989    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852993    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.852997    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853001    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853004    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853008    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853012    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853015    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853021    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.888785 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853025    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853029    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853032    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853036    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853040    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853044    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853054    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853058    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853062    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853065    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853069    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853073    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853076    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853080    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853085    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853089    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853093    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853097    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853101    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853105    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.889372 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.853109    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.854013    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.886782    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.886801    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.887489    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.887500    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887569    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887575    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887579    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887582    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887585    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887589    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887594    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887597    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887600    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.889935 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887603    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887606    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887609    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887612    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887615    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887618    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887620    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887623    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887625    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887628    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887630    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887633    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887635    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887638    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887641    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887643    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887646    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887649    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887652    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887654    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.890421 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887665    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887668    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887670    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887673    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887675    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887678    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887681    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887683    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887686    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887688    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887691    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887693    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887696    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887698    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887701    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887704    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887706    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887709    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887712    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887714    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.890936 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887717    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887720    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887722    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887725    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887728    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887730    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887733    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887735    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887738    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887740    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887743    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887745    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887748    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887756    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887759    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887761    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887764    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887766    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887769    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887771    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.891544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887776    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887779    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887781    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887784    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887787    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887789    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887792    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887795    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887797    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887800    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887802    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887806    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887810    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887812    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887816    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887818    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887821    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887824    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.892061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887826    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887829    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887831    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887834    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887836    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887838    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887842    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887851    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887855    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887859    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.887862    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.887867    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888026    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888031    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.892607 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888034    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888037    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888040    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888043    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888046    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888049    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888051    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888054    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888057    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888060    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888062    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888065    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888068    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888071    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888074    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888077    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888079    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888082    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888085    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888088    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.892988 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888090    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888093    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888096    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888098    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888101    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888103    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888112    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888115    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888119    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888123    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888125    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888128    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888131    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888133    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888136    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888139    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888141    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888144    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888147    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888150    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.893554 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888152    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888156    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888160    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888163    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888166    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888168    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888171    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888174    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888176    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888180    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888183    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888186    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888189    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888191    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888194    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888197    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888200    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888202    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888205    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.894063 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888214    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888217    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888220    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888222    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888225    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888229    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888231    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888234    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888236    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888239    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888241    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888244    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888246    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888248    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888251    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888253    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888256    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888258    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888261    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888263    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.894676 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888266    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888268    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888271    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888273    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888276    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888292    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888296    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888299    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888301    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888304    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888306    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888309    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888312    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888321    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888324    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888326    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888328    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.895357 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:37.888331    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.888336    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.888484    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.890772    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.892042    2563 server.go:1019] "Starting client certificate rotation"
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.892137    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.892173    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:37.895998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.894850    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:37.956361 ip-10-0-135-117 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.900913    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.917963    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.927197    2563 log.go:25] "Validated CRI v1 image API"
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.928704    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.931151    2563 fs.go:135] Filesystem UUIDs: map[08df3d71-4b74-41cb-8c55-01e9ccf5cdfa:/dev/nvme0n1p4 3b2fe399-6f14-437e-be7e-45b045f3fa30:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 20 19:00:37.970570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.931170    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.935418    2563 manager.go:216] Machine: {Timestamp:2026-07-20 19:00:37.934932839 +0000 UTC m=+0.342929503 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100618 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2afca541b3c2a8ac178f2e9da7ed7b SystemUUID:ec2afca5-41b3-c2a8-ac17-8f2e9da7ed7b BootID:78616d7f-6ac2-4c2d-806a-7a97bf178ee3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:6a:40:fd:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:6a:40:fd:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:f2:91:85:b3:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.935537    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.935645    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.938332    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.938364    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.938995    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.939006    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.939014    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.940258    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.941789    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.943847    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.944943    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945045    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945068    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945076    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945091    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:00:37.971175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945100    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945109    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945413    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.945429    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.948879    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.951180    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.951207    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952343    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952356    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952362    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952368    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952377    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952382    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952391    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952396    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952403    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952408    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952417    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952423    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952444    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.952449    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.955747    2563 server.go:1268] "Started kubelet"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.956105    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.957548    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.958293    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.958323    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.959671    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:00:37.972156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.971267    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l765"
Jul 20 19:00:37.973499 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.972247    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:00:37.973499 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:37.972358    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:00:37.973499 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:37.972399    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.976760    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5l765"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:37.976979    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.981704    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.981715    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:37.981781    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.982386    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.982400    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.982499    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.982527    2563 factory.go:55] Registering systemd factory
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.982586    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983361    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983379    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983540    2563 factory.go:153] Registering CRI-O factory
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983555    2563 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983606    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983628    2563 factory.go:103] Registering Raw factory
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.983641    2563 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.984023    2563 manager.go:349] Starting recovery of all containers
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.989205    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.992174    2563 manager.go:354] Recovery completed
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:37.992529    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-117.ec2.internal\" not found" node="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.996199    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.997894    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.997916    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.997929    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.998412    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.998430    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.998432    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.998489    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999475    2563 policy_none.go:49] "None policy: Start"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999490    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999503    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999542    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999569    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:37.999582    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.000735    2563 policy_none.go:47] "Start"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049356    2563 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.049391    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049406    2563 server.go:87] "Starting device plugin registration server"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049675    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049689    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049786    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049853    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:00:38.053814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.049862    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.063640    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.063702    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.150481    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.151360    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.151388    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.151401    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.152732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.151433    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:38.165178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.160889    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:38.165178 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.160908    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-117.ec2.internal\": node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.174956    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.193167    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.194326    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.194364    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.194382    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:38.194414    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:00:40.458290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:38.196714    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.502350    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.521823    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"]
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.521887    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.522704    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.522726    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.522737    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.523899    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524061    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524612    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524617    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524649    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524661    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524650    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.524734    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.525706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.525727    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.527202    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.527229    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.533249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.527243    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.598112 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.592138    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-117.ec2.internal\" not found" node="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.598112 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.596221    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-117.ec2.internal\" not found" node="ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.603781 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.602591    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.694746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.618802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.694746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.618837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.694746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.618860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0c8e33f498af61e3378f629da1c93b8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-117.ec2.internal\" (UID: \"b0c8e33f498af61e3378f629da1c93b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.703141    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0c8e33f498af61e3378f629da1c93b8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-117.ec2.internal\" (UID: \"b0c8e33f498af61e3378f629da1c93b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0c8e33f498af61e3378f629da1c93b8-config\") pod \"kube-apiserver-proxy-ip-10-0-135-117.ec2.internal\" (UID: \"b0c8e33f498af61e3378f629da1c93b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.777097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.719549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918d464bd4f2d3095d931aed82115195-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal\" (UID: \"918d464bd4f2d3095d931aed82115195\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.856958 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.803584    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:40.932962 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.896135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.932962 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:40.900517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:40.932962 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:40.904482    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:41.034341 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.005006    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-117.ec2.internal\" not found"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.061561    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.108316    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.118598    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.118705    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.118740    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.118745    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.118795    2563 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a043e90ecf6d84adb82bd893b3fa0cca-0ef8ae0f896450fa.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.135.117:47436->23.22.137.101:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.118827    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal"
Jul 20 19:00:41.139597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.135888    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.171962    2563 apiserver.go:52] "Watching apiserver"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.183435    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.184704    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-4wrwq","openshift-multus/multus-xlw65","openshift-ovn-kubernetes/ovnkube-node-8mmzh","kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld","openshift-dns/node-resolver-r92cd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-n6v25","openshift-multus/network-metrics-daemon-2mqms","openshift-network-diagnostics/network-check-target-p84cn","openshift-network-operator/iptables-alerter-mnwpm","kube-system/global-pull-secret-syncer-8t5rd","kube-system/konnectivity-agent-vtjzs","openshift-cluster-node-tuning-operator/tuned-h4pm7"]
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.186109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.187614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.188736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.189438    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.189506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zq2z5\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.190199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.190351    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.191706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.191743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.191958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6pnl4\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.192368    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.192369    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.192410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.192511    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.192546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-84j7c\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.193399    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.193399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.193435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.193466    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.193498    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.194596    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.194674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.194842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.195326    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.195353    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8pwtb\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.195824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.196199    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.196468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.196496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tbrrq\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.196591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.196988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.210744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.197158    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l84n7\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.197347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.197867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.198170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.198250    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.198642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.198674    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.198922    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvbg9\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.199226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.199279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.199459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bw5c\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.199484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.199653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.200286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.201348    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.201391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.202809    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.202855    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.203036    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpss2\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.203213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.208652    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 18:55:40 +0000 UTC" deadline="2028-02-28 13:14:18.870957892 +0000 UTC"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.208681    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.208687    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14106h13m37.662273582s"
Jul 20 19:00:41.211995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.209974    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:00:41.220233 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.220219    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:41.222413 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-slash\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-host\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.222459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-os-release\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.222551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-k8s-cni-cncf-io\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.222551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-device-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.222551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkvtp\" (UniqueName: \"kubernetes.io/projected/805af851-de16-4d90-b6bf-292c482b5926-kube-api-access-dkvtp\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.222661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c97pc\" (UniqueName: \"kubernetes.io/projected/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-kube-api-access-c97pc\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.222661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-ovn\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-bin\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysconfig\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.222661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-conf\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-sys\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-dbus\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-systemd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-tmp\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-netns\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.222848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-env-overrides\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29pdv\" (UniqueName: \"kubernetes.io/projected/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-kube-api-access-29pdv\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-hostroot\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-multus-certs\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-registration-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.222984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-var-lib-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-run\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.223126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-var-lib-kubelet\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-cni-binary-copy\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-kubelet\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-etc-kubernetes\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fs6d\" (UniqueName: \"kubernetes.io/projected/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-kube-api-access-6fs6d\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.223404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-netns\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-socket-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-etc-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovn-node-metrics-cert\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-os-release\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-multus-daemon-config\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-sys-fs\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.223596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-system-cni-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh96r\" (UniqueName: \"kubernetes.io/projected/2d98a244-009f-4dd6-be61-c588d549bbb7-kube-api-access-sh96r\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-host-slash\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-kubelet-config\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-script-lib\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-tuned\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-system-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-socket-dir-parent\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.223825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-log-socket\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-kubernetes\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-cnibin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-systemd-units\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab6e36f0-2426-4402-bdb6-f0d09978aeda-hosts-file\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv9sb\" (UniqueName: \"kubernetes.io/projected/ab6e36f0-2426-4402-bdb6-f0d09978aeda-kube-api-access-qv9sb\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-lib-modules\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.223999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rs4r\" (UniqueName: \"kubernetes.io/projected/2271c277-e9bc-40a1-a143-dca573b3acfa-kube-api-access-8rs4r\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-bin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.224052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-modprobe-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-cnibin\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-multus\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj52d\" (UniqueName: \"kubernetes.io/projected/459e61c5-565c-49a4-8862-683c1116c1d4-kube-api-access-sj52d\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh69h\" (UniqueName: \"kubernetes.io/projected/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-kube-api-access-xh69h\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/701ed924-7ad8-446c-9857-0e93c1e6d469-agent-certs\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-systemd\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/701ed924-7ad8-446c-9857-0e93c1e6d469-konnectivity-ca\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-config\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab6e36f0-2426-4402-bdb6-f0d09978aeda-tmp-dir\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.224537 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-host\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-iptables-alerter-script\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-kubelet\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-node-log\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-netd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-serviceca\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.225095 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.224620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-conf-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.242769 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.242741    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6hr6"
Jul 20 19:00:41.250607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.250592    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r6hr6"
Jul 20 19:00:41.325626 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-log-socket\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.325721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-kubernetes\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.325721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-cnibin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.325721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-systemd-units\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.325721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-log-socket\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab6e36f0-2426-4402-bdb6-f0d09978aeda-hosts-file\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-systemd-units\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-kubernetes\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv9sb\" (UniqueName: \"kubernetes.io/projected/ab6e36f0-2426-4402-bdb6-f0d09978aeda-kube-api-access-qv9sb\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-lib-modules\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab6e36f0-2426-4402-bdb6-f0d09978aeda-hosts-file\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-cnibin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rs4r\" (UniqueName: \"kubernetes.io/projected/2271c277-e9bc-40a1-a143-dca573b3acfa-kube-api-access-8rs4r\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-bin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.325887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-modprobe-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-cnibin\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-lib-modules\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325952    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-cnibin\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-modprobe-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.325989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-bin\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-multus\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj52d\" (UniqueName: \"kubernetes.io/projected/459e61c5-565c-49a4-8862-683c1116c1d4-kube-api-access-sj52d\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-cni-multus\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh69h\" (UniqueName: \"kubernetes.io/projected/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-kube-api-access-xh69h\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.326376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/701ed924-7ad8-446c-9857-0e93c1e6d469-agent-certs\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-systemd\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/701ed924-7ad8-446c-9857-0e93c1e6d469-konnectivity-ca\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-config\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab6e36f0-2426-4402-bdb6-f0d09978aeda-tmp-dir\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-host\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-systemd\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-iptables-alerter-script\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-kubelet\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-node-log\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-netd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-node-log\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-netd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.327273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-kubelet\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-serviceca\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-host\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326729    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-etc-selinux\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-conf-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326786    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab6e36f0-2426-4402-bdb6-f0d09978aeda-tmp-dir\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-conf-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-slash\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-host\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-os-release\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.326986    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/701ed924-7ad8-446c-9857-0e93c1e6d469-konnectivity-ca\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-k8s-cni-cncf-io\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-device-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-slash\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-k8s-cni-cncf-io\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.328194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkvtp\" (UniqueName: \"kubernetes.io/projected/805af851-de16-4d90-b6bf-292c482b5926-kube-api-access-dkvtp\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327116    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-device-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-host\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-os-release\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-config\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c97pc\" (UniqueName: \"kubernetes.io/projected/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-kube-api-access-c97pc\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-ovn\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-bin\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysconfig\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-serviceca\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-conf\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-ovn\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-sys\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysconfig\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-dbus\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-sys\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-systemd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-iptables-alerter-script\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.329314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-cni-bin\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-tmp\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-systemd\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-dbus\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-conf\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-netns\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-env-overrides\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29pdv\" (UniqueName: \"kubernetes.io/projected/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-kube-api-access-29pdv\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-netns\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-hostroot\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-hostroot\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-multus-certs\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-multus-certs\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-registration-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-var-lib-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-run\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.330255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-registration-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-var-lib-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-var-lib-kubelet\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-run\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-cni-binary-copy\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-var-lib-kubelet\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-kubelet\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-etc-kubernetes\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.327837    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fs6d\" (UniqueName: \"kubernetes.io/projected/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-kube-api-access-6fs6d\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-netns\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327909    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-etc-kubernetes\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-env-overrides\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-socket-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-etc-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-run-netns\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.331151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovn-node-metrics-cert\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.327951    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-host-var-lib-kubelet\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.328054    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:41.8280147 +0000 UTC m=+2.009537872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-socket-dir\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-etc-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-os-release\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-multus-daemon-config\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-sys-fs\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-system-cni-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh96r\" (UniqueName: \"kubernetes.io/projected/2d98a244-009f-4dd6-be61-c588d549bbb7-kube-api-access-sh96r\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-host-slash\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-cni-binary-copy\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-kubelet-config\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-os-release\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d53abec-004c-4159-b75d-8186ce8fb603-kubelet-config\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-script-lib\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-tuned\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-system-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-socket-dir-parent\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2271c277-e9bc-40a1-a143-dca573b3acfa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2271c277-e9bc-40a1-a143-dca573b3acfa-system-cni-dir\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805af851-de16-4d90-b6bf-292c482b5926-sys-fs\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-system-cni-dir\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/459e61c5-565c-49a4-8862-683c1116c1d4-multus-daemon-config\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-sysctl-d\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.328789    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-run-openvswitch\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.328835    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:41.82881875 +0000 UTC m=+2.010341923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/459e61c5-565c-49a4-8862-683c1116c1d4-multus-socket-dir-parent\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.328751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-host-slash\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.329106    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovnkube-script-lib\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.332939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.330364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-tmp\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.330423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-ovn-node-metrics-cert\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.330605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/701ed924-7ad8-446c-9857-0e93c1e6d469-agent-certs\") pod \"konnectivity-agent-vtjzs\" (UID: \"701ed924-7ad8-446c-9857-0e93c1e6d469\") " pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.330750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-etc-tuned\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.333215    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.333234    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.333248    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:41.333850 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.333314    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:00:41.833297608 +0000 UTC m=+2.014820798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:41.334694 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.334661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv9sb\" (UniqueName: \"kubernetes.io/projected/ab6e36f0-2426-4402-bdb6-f0d09978aeda-kube-api-access-qv9sb\") pod \"node-resolver-r92cd\" (UID: \"ab6e36f0-2426-4402-bdb6-f0d09978aeda\") " pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.334864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.334844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rs4r\" (UniqueName: \"kubernetes.io/projected/2271c277-e9bc-40a1-a143-dca573b3acfa-kube-api-access-8rs4r\") pod \"multus-additional-cni-plugins-n6v25\" (UID: \"2271c277-e9bc-40a1-a143-dca573b3acfa\") " pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.335034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.335018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj52d\" (UniqueName: \"kubernetes.io/projected/459e61c5-565c-49a4-8862-683c1116c1d4-kube-api-access-sj52d\") pod \"multus-xlw65\" (UID: \"459e61c5-565c-49a4-8862-683c1116c1d4\") " pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.335160 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.335144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh69h\" (UniqueName: \"kubernetes.io/projected/fa939486-ffc3-45c0-a6a8-adba27a2f2a6-kube-api-access-xh69h\") pod \"tuned-h4pm7\" (UID: \"fa939486-ffc3-45c0-a6a8-adba27a2f2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.337660 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.337634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c97pc\" (UniqueName: \"kubernetes.io/projected/83822cf1-7092-4dfa-9d89-dac3b4a3b8b1-kube-api-access-c97pc\") pod \"iptables-alerter-mnwpm\" (UID: \"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1\") " pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.338161 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.338141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29pdv\" (UniqueName: \"kubernetes.io/projected/9dab84bb-c8b8-411d-ad50-98c9104ca8c8-kube-api-access-29pdv\") pod \"ovnkube-node-8mmzh\" (UID: \"9dab84bb-c8b8-411d-ad50-98c9104ca8c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.338241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.338227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkvtp\" (UniqueName: \"kubernetes.io/projected/805af851-de16-4d90-b6bf-292c482b5926-kube-api-access-dkvtp\") pod \"aws-ebs-csi-driver-node-8g9ld\" (UID: \"805af851-de16-4d90-b6bf-292c482b5926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.339325 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.339304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh96r\" (UniqueName: \"kubernetes.io/projected/2d98a244-009f-4dd6-be61-c588d549bbb7-kube-api-access-sh96r\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.339439 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.339421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fs6d\" (UniqueName: \"kubernetes.io/projected/ed7c12d2-c7df-4da6-a842-a2b60e7cdd92-kube-api-access-6fs6d\") pod \"node-ca-4wrwq\" (UID: \"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92\") " pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.359393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.359371    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:41.363233 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.363213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h4pm7"
Jul 20 19:00:41.389033 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.389015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6v25"
Jul 20 19:00:41.396559 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.396541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnwpm"
Jul 20 19:00:41.491667 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.491616    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918d464bd4f2d3095d931aed82115195.slice/crio-f7931e5a6eff7d5120b3aa12624ec10b016b12359434c5d06717d62890885fdc WatchSource:0}: Error finding container f7931e5a6eff7d5120b3aa12624ec10b016b12359434c5d06717d62890885fdc: Status 404 returned error can't find the container with id f7931e5a6eff7d5120b3aa12624ec10b016b12359434c5d06717d62890885fdc
Jul 20 19:00:41.492549 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.492521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c8e33f498af61e3378f629da1c93b8.slice/crio-107b56565ad71ffb4ab529b0ffd1cdd0750150b4b979c6ca53d360e9a7ee6a33 WatchSource:0}: Error finding container 107b56565ad71ffb4ab529b0ffd1cdd0750150b4b979c6ca53d360e9a7ee6a33: Status 404 returned error can't find the container with id 107b56565ad71ffb4ab529b0ffd1cdd0750150b4b979c6ca53d360e9a7ee6a33
Jul 20 19:00:41.496687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.496664    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:00:41.575825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.575770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:00:41.582687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.582657    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlw65"
Jul 20 19:00:41.585840 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.585818    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701ed924_7ad8_446c_9857_0e93c1e6d469.slice/crio-360f7fd3290a699d2f87f551ed77c10b4afde4711230c9d65d63e40648c99352 WatchSource:0}: Error finding container 360f7fd3290a699d2f87f551ed77c10b4afde4711230c9d65d63e40648c99352: Status 404 returned error can't find the container with id 360f7fd3290a699d2f87f551ed77c10b4afde4711230c9d65d63e40648c99352
Jul 20 19:00:41.588844 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.588808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:00:41.591131 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.591112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459e61c5_565c_49a4_8862_683c1116c1d4.slice/crio-89ac32e8bd1695715b56d097128ac2927bb981c5c94010c289e550028072bcb5 WatchSource:0}: Error finding container 89ac32e8bd1695715b56d097128ac2927bb981c5c94010c289e550028072bcb5: Status 404 returned error can't find the container with id 89ac32e8bd1695715b56d097128ac2927bb981c5c94010c289e550028072bcb5
Jul 20 19:00:41.596751 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.596733    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dab84bb_c8b8_411d_ad50_98c9104ca8c8.slice/crio-94fff9b1a2b13a3eeeac5755bde25091f2b28cb6cdfe5186dc7b68823c7558c3 WatchSource:0}: Error finding container 94fff9b1a2b13a3eeeac5755bde25091f2b28cb6cdfe5186dc7b68823c7558c3: Status 404 returned error can't find the container with id 94fff9b1a2b13a3eeeac5755bde25091f2b28cb6cdfe5186dc7b68823c7558c3
Jul 20 19:00:41.612768 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.612741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wrwq"
Jul 20 19:00:41.617380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.617364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld"
Jul 20 19:00:41.620785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.620770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r92cd"
Jul 20 19:00:41.620950 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.620920    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7c12d2_c7df_4da6_a842_a2b60e7cdd92.slice/crio-e005a2d9c37c0f76a27f51663a70f18cee7e900799cb80ffbc7b1ad8f20f9122 WatchSource:0}: Error finding container e005a2d9c37c0f76a27f51663a70f18cee7e900799cb80ffbc7b1ad8f20f9122: Status 404 returned error can't find the container with id e005a2d9c37c0f76a27f51663a70f18cee7e900799cb80ffbc7b1ad8f20f9122
Jul 20 19:00:41.625069 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.625048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805af851_de16_4d90_b6bf_292c482b5926.slice/crio-dd4cdea43b2211d760e00af3be0197c35c01c4df3ae708575d9d0e657b123721 WatchSource:0}: Error finding container dd4cdea43b2211d760e00af3be0197c35c01c4df3ae708575d9d0e657b123721: Status 404 returned error can't find the container with id dd4cdea43b2211d760e00af3be0197c35c01c4df3ae708575d9d0e657b123721
Jul 20 19:00:41.629566 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.629548    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6e36f0_2426_4402_bdb6_f0d09978aeda.slice/crio-926d72211cda787a2642a1b8e9a5538bf1d07651b5ef70e240d0977ec4761d4d WatchSource:0}: Error finding container 926d72211cda787a2642a1b8e9a5538bf1d07651b5ef70e240d0977ec4761d4d: Status 404 returned error can't find the container with id 926d72211cda787a2642a1b8e9a5538bf1d07651b5ef70e240d0977ec4761d4d
Jul 20 19:00:41.708419 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.708398    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa939486_ffc3_45c0_a6a8_adba27a2f2a6.slice/crio-7d41664ec93cb2ef8ff9d464a97cc9d96e7e3b5220d6fea2cd79b1dbbaf584ca WatchSource:0}: Error finding container 7d41664ec93cb2ef8ff9d464a97cc9d96e7e3b5220d6fea2cd79b1dbbaf584ca: Status 404 returned error can't find the container with id 7d41664ec93cb2ef8ff9d464a97cc9d96e7e3b5220d6fea2cd79b1dbbaf584ca
Jul 20 19:00:41.817411 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:41.817378    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83822cf1_7092_4dfa_9d89_dac3b4a3b8b1.slice/crio-ab8a8889c2e625ce6a5803680632c2e6936dd3e335ce6b631fc84fabbc2414c1 WatchSource:0}: Error finding container ab8a8889c2e625ce6a5803680632c2e6936dd3e335ce6b631fc84fabbc2414c1: Status 404 returned error can't find the container with id ab8a8889c2e625ce6a5803680632c2e6936dd3e335ce6b631fc84fabbc2414c1
Jul 20 19:00:41.832595 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.832536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:41.832595 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.832576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:41.832728 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.832680    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:41.832778 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.832732    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:41.832778 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.832736    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.832715924 +0000 UTC m=+3.014239106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:41.832849 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.832794    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.832782856 +0000 UTC m=+3.014306028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:41.933017 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:41.932988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:41.933140 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.933125    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:41.933182 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.933144    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:41.933182 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.933154    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:41.933248 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:41.933195    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.933182979 +0000 UTC m=+3.114706147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.094112 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.093907    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:42.252412 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.252346    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:41 +0000 UTC" deadline="2028-02-18 07:56:43.453098043 +0000 UTC"
Jul 20 19:00:42.252412 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.252410    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13860h56m1.200692629s"
Jul 20 19:00:42.437691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.437579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlw65" event={"ID":"459e61c5-565c-49a4-8862-683c1116c1d4","Type":"ContainerStarted","Data":"89ac32e8bd1695715b56d097128ac2927bb981c5c94010c289e550028072bcb5"}
Jul 20 19:00:42.449557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.449515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal" event={"ID":"918d464bd4f2d3095d931aed82115195","Type":"ContainerStarted","Data":"f7931e5a6eff7d5120b3aa12624ec10b016b12359434c5d06717d62890885fdc"}
Jul 20 19:00:42.459108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.459077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal" event={"ID":"b0c8e33f498af61e3378f629da1c93b8","Type":"ContainerStarted","Data":"107b56565ad71ffb4ab529b0ffd1cdd0750150b4b979c6ca53d360e9a7ee6a33"}
Jul 20 19:00:42.473552 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.473518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnwpm" event={"ID":"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1","Type":"ContainerStarted","Data":"ab8a8889c2e625ce6a5803680632c2e6936dd3e335ce6b631fc84fabbc2414c1"}
Jul 20 19:00:42.483148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.482433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h4pm7" event={"ID":"fa939486-ffc3-45c0-a6a8-adba27a2f2a6","Type":"ContainerStarted","Data":"7d41664ec93cb2ef8ff9d464a97cc9d96e7e3b5220d6fea2cd79b1dbbaf584ca"}
Jul 20 19:00:42.484901 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.484873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld" event={"ID":"805af851-de16-4d90-b6bf-292c482b5926","Type":"ContainerStarted","Data":"dd4cdea43b2211d760e00af3be0197c35c01c4df3ae708575d9d0e657b123721"}
Jul 20 19:00:42.493905 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.493882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtjzs" event={"ID":"701ed924-7ad8-446c-9857-0e93c1e6d469","Type":"ContainerStarted","Data":"360f7fd3290a699d2f87f551ed77c10b4afde4711230c9d65d63e40648c99352"}
Jul 20 19:00:42.498474 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.498411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r92cd" event={"ID":"ab6e36f0-2426-4402-bdb6-f0d09978aeda","Type":"ContainerStarted","Data":"926d72211cda787a2642a1b8e9a5538bf1d07651b5ef70e240d0977ec4761d4d"}
Jul 20 19:00:42.509630 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.509561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wrwq" event={"ID":"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92","Type":"ContainerStarted","Data":"e005a2d9c37c0f76a27f51663a70f18cee7e900799cb80ffbc7b1ad8f20f9122"}
Jul 20 19:00:42.527792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.527623    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"94fff9b1a2b13a3eeeac5755bde25091f2b28cb6cdfe5186dc7b68823c7558c3"}
Jul 20 19:00:42.686252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.686221    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:42.730729 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.730654    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:42.744805 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:00:42.744729    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2271c277_e9bc_40a1_a143_dca573b3acfa.slice/crio-843262b30b9b189e7b0c8c3c8019ae6a1540044fb42995eaa7bda380cc052f3e WatchSource:0}: Error finding container 843262b30b9b189e7b0c8c3c8019ae6a1540044fb42995eaa7bda380cc052f3e: Status 404 returned error can't find the container with id 843262b30b9b189e7b0c8c3c8019ae6a1540044fb42995eaa7bda380cc052f3e
Jul 20 19:00:42.840689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.840655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:42.840860 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.840712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:42.840924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.840867    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:42.840973 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.840927    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.840908499 +0000 UTC m=+5.022431669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:42.841315 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.841295    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.841409 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.841346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.841332259 +0000 UTC m=+5.022855433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.941330 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:42.941290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:42.941515 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.941465    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:42.941515 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.941505    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:42.941624 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.941531    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.941624 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:42.941593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:00:44.94157478 +0000 UTC m=+5.123097951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:43.252895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.252683    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:41 +0000 UTC" deadline="2028-01-28 19:00:59.324167083 +0000 UTC"
Jul 20 19:00:43.252895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.252741    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13368h0m16.071429706s"
Jul 20 19:00:43.421485 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.421453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:43.421656 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:43.421594    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:43.422032 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.422013    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:43.422128 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:43.422109    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:43.422184 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.422174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:43.422283 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:43.422249    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:43.548604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:43.548525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerStarted","Data":"843262b30b9b189e7b0c8c3c8019ae6a1540044fb42995eaa7bda380cc052f3e"}
Jul 20 19:00:44.857121 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:44.857085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:44.857656 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:44.857142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:44.857656 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.857293    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:44.857656 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.857357    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:48.857336131 +0000 UTC m=+9.038859304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:44.857864 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.857746    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:44.857864 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.857813    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:48.857796654 +0000 UTC m=+9.039319829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:44.958159 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:44.958071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:44.958314 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.958283    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:44.958314 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.958308    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:44.958449 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.958323    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:44.958449 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:44.958381    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:00:48.958364159 +0000 UTC m=+9.139887339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:45.421587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:45.421551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:45.421791 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:45.421690    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:45.422117 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:45.422075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:45.422216 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:45.422188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:45.422273 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:45.422238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:45.422329 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:45.422311    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:47.421688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:47.421720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:47.421688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:47.421845    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:47.421937    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:47.422145 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:47.422003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:48.893194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:48.893156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:48.893606 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:48.893215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:48.893606 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.893318    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:48.893606 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.893333    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:48.893606 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.893379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:56.893360767 +0000 UTC m=+17.074883942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:48.893606 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.893398    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:56.893387739 +0000 UTC m=+17.074910910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:48.994513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:48.993932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:48.994513 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.994121    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:48.994513 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.994144    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:48.994513 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.994157    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:48.994513 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:48.994216    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:00:56.994197932 +0000 UTC m=+17.175721117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:49.421903 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:49.421867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:49.422088 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:49.422002    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:49.422335 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:49.422172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:49.422335 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:49.422198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:49.422335 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:49.422255    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:49.422335 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:49.422315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:51.421999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:51.421917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:51.422437 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:51.422044    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:51.422437 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:51.421917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:51.422437 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:51.422176    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:51.422437 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:51.421917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:51.422437 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:51.422282    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:53.421676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:53.421640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:53.421676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:53.421666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:53.422060 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:53.421740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:53.422060 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:53.421651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:53.422060 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:53.421841    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:53.422060 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:53.421903    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:55.421864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:55.421830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:55.421864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:55.421854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:55.421864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:55.421867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:55.422400 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:55.421960    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:55.422400 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:55.422333    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:55.422907 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:55.422848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:56.955134 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:56.955094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:56.955602 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:56.955160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:56.955602 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:56.955300    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:56.955602 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:56.955312    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:56.955602 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:56.955356    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:12.955338653 +0000 UTC m=+33.136861821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:56.955602 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:56.955371    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:12.955364405 +0000 UTC m=+33.136887573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:57.055968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:57.055933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:57.056162 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.056109    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:57.056162 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.056136    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:57.056162 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.056149    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:57.056296 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.056201    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:01:13.056182078 +0000 UTC m=+33.237705247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:57.421747 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:57.421711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:57.421937 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:57.421711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:57.421937 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.421832    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:57.421937 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:57.421713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:57.421937 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.421912    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:00:57.422152 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:57.422003    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:59.421180 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:59.421139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:00:59.421180 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:59.421177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:00:59.421714 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:00:59.421269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:00:59.421714 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:59.421283    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:00:59.421714 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:59.421374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:00:59.421714 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:00:59.421457    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:01.421494 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:01.421462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:01.421494 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:01.421481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:01.422000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:01.421467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:01.422000 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:01.421563    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:01.422000 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:01.421639    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:01.422000 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:01.421710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:02.589890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.589603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"b08ced5e347ceb8eddc3f0b04904a4d637bf2b31f4bd6631735f9355cbaf7ad3"}
Jul 20 19:01:02.593888 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.593861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlw65" event={"ID":"459e61c5-565c-49a4-8862-683c1116c1d4","Type":"ContainerStarted","Data":"9490317a7b2bbf3395080524fa2996595734a9df549ab55bd1cbcd45ac6f8084"}
Jul 20 19:01:02.595414 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.595389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal" event={"ID":"b0c8e33f498af61e3378f629da1c93b8","Type":"ContainerStarted","Data":"2616fe65e4b5db908d36e4bdbd9de3bf51823eb7ac8183279b4ffbba1e1f8ecb"}
Jul 20 19:01:02.596736 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.596716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h4pm7" event={"ID":"fa939486-ffc3-45c0-a6a8-adba27a2f2a6","Type":"ContainerStarted","Data":"a0324539febb49f0660ab5c36afc78e4be24f89ea9b8f7b241167926c5fa2fa5"}
Jul 20 19:01:02.613918 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.613876    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xlw65" podStartSLOduration=2.2937685119999998 podStartE2EDuration="22.613861461s" totalImagesPullingTime="20.320092949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:02.613453207 +0000 UTC m=+22.794976415" watchObservedRunningTime="2026-07-20 19:01:02.613861461 +0000 UTC m=+22.795384651"
Jul 20 19:01:02.632202 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.632160    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h4pm7" podStartSLOduration=2.463625206 podStartE2EDuration="22.632145903s" totalImagesPullingTime="20.168520697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:02.631384837 +0000 UTC m=+22.812908026" watchObservedRunningTime="2026-07-20 19:01:02.632145903 +0000 UTC m=+22.813669462"
Jul 20 19:01:02.645939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:02.645897    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-117.ec2.internal" podStartSLOduration=21.645879637 podStartE2EDuration="21.645879637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:02.645364614 +0000 UTC m=+22.826887805" watchObservedRunningTime="2026-07-20 19:01:02.645879637 +0000 UTC m=+22.827402830"
Jul 20 19:01:03.422140 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.421973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:03.422337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.422025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:03.422337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.422031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:03.422444 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:03.422203    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:03.422444 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:03.422277    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:03.422444 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:03.422384    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:03.600647 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.600603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wrwq" event={"ID":"ed7c12d2-c7df-4da6-a842-a2b60e7cdd92","Type":"ContainerStarted","Data":"a69e93ef0f6b991db45a8394fd2f7ca87a6d07e0953a7495baa0b5fc37aad31d"}
Jul 20 19:01:03.603339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603319    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:01:03.603666 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603641    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dab84bb-c8b8-411d-ad50-98c9104ca8c8" containerID="3c54bd609e1932f7c6c29b2fe59a90cd95589563ccc0e1de4da272cdd8af35d2" exitCode=1
Jul 20 19:01:03.603740 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"75f9be745f363a76355afc89257ba7f36d0f2ad9c3ed0776d689cc4024d72b36"}
Jul 20 19:01:03.603820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"a54bda2c26476b8903ca6e3363c0dd701c015d751dc6be108052fb331b2d4deb"}
Jul 20 19:01:03.603925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603841    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"f47177fb52642600cc37ba6718556155f6254406b4cf5d8e78034d9748c5affe"}
Jul 20 19:01:03.603925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"b7ac81abdb00a5a182d60a005bc42106e809031e7c180e66926bc6088f23b6fe"}
Jul 20 19:01:03.604012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.603931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerDied","Data":"3c54bd609e1932f7c6c29b2fe59a90cd95589563ccc0e1de4da272cdd8af35d2"}
Jul 20 19:01:03.605120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.605101    2563 generic.go:356] "Generic (PLEG): container finished" podID="918d464bd4f2d3095d931aed82115195" containerID="272b8d976aadac853aaff414cdafa013433d811c0ee1a76e00ccc80c439edf27" exitCode=0
Jul 20 19:01:03.605198 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.605166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal" event={"ID":"918d464bd4f2d3095d931aed82115195","Type":"ContainerDied","Data":"272b8d976aadac853aaff414cdafa013433d811c0ee1a76e00ccc80c439edf27"}
Jul 20 19:01:03.606498 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.606478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnwpm" event={"ID":"83822cf1-7092-4dfa-9d89-dac3b4a3b8b1","Type":"ContainerStarted","Data":"853a3f463034bbfd10668ec4273ba86633aabedb51667be3face307145c8bddf"}
Jul 20 19:01:03.607896 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.607873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld" event={"ID":"805af851-de16-4d90-b6bf-292c482b5926","Type":"ContainerStarted","Data":"8c7c0e39e13a1c9b35516035e5d971e03446f3aed968d304c770e0e5aa7992cb"}
Jul 20 19:01:03.609105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.609084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vtjzs" event={"ID":"701ed924-7ad8-446c-9857-0e93c1e6d469","Type":"ContainerStarted","Data":"9d4b78c3b0a1e32514cc6adf6e089639f2d33f416ed64822cc28abde920f3fd2"}
Jul 20 19:01:03.610402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.610382    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="b67e83f053d37c16b1416cf7c21790b70b0bb6a2f22994e971e145afedab97b2" exitCode=0
Jul 20 19:01:03.610490 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.610460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"b67e83f053d37c16b1416cf7c21790b70b0bb6a2f22994e971e145afedab97b2"}
Jul 20 19:01:03.611808 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.611728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r92cd" event={"ID":"ab6e36f0-2426-4402-bdb6-f0d09978aeda","Type":"ContainerStarted","Data":"7ff1e0057d90470d31750dde19598c8a4086090c5e0d528bf5abc2d2d96f2059"}
Jul 20 19:01:03.616059 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.616022    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4wrwq" podStartSLOduration=3.386677031 podStartE2EDuration="23.616011365s" totalImagesPullingTime="20.229334334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:03.615644195 +0000 UTC m=+23.797167385" watchObservedRunningTime="2026-07-20 19:01:03.616011365 +0000 UTC m=+23.797534554"
Jul 20 19:01:03.630324 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.630282    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vtjzs" podStartSLOduration=3.388031252 podStartE2EDuration="23.630266909s" totalImagesPullingTime="20.242235657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:03.630161869 +0000 UTC m=+23.811685089" watchObservedRunningTime="2026-07-20 19:01:03.630266909 +0000 UTC m=+23.811790099"
Jul 20 19:01:03.644877 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.644845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mnwpm" podStartSLOduration=3.612257129 podStartE2EDuration="23.644830513s" totalImagesPullingTime="20.032573384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:03.644483086 +0000 UTC m=+23.826006276" watchObservedRunningTime="2026-07-20 19:01:03.644830513 +0000 UTC m=+23.826353702"
Jul 20 19:01:03.659646 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:03.659598    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r92cd" podStartSLOduration=3.409753221 podStartE2EDuration="23.659581278s" totalImagesPullingTime="20.249828057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:03.659520054 +0000 UTC m=+23.841043245" watchObservedRunningTime="2026-07-20 19:01:03.659581278 +0000 UTC m=+23.841104469"
Jul 20 19:01:04.396274 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:04.396085    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:01:04.616539 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:04.616439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld" event={"ID":"805af851-de16-4d90-b6bf-292c482b5926","Type":"ContainerStarted","Data":"c139d965fa0647b8c054d16f1da68d34553d2a065bda40478fa00670badd7131"}
Jul 20 19:01:04.618517 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:04.618479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal" event={"ID":"918d464bd4f2d3095d931aed82115195","Type":"ContainerStarted","Data":"73d1faeb98ca7588f0a0825fb79c0a6e73fce15bf0594e03a6a4cb528cc9fcb9"}
Jul 20 19:01:04.634364 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:04.634315    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-117.ec2.internal" podStartSLOduration=23.634297899 podStartE2EDuration="23.634297899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.634247269 +0000 UTC m=+24.815770459" watchObservedRunningTime="2026-07-20 19:01:04.634297899 +0000 UTC m=+24.815821091"
Jul 20 19:01:05.291013 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.290936    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:01:04.396263661Z","UUID":"6498cf56-ba60-44d2-ab78-d55bf0b32d19","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:01:05.292720 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.292699    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:01:05.292854 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.292747    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:01:05.421820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.421789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:05.422032 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.421828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:05.422032 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.421905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:05.422032 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:05.421918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:05.422191 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:05.422077    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:05.422191 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:05.422178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:05.624822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.624792    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:01:05.625320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:05.625256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"ac9601b3bbb27a2ab81ef75d0f42b005a626623c89b9d6443a2fb990d13d067e"}
Jul 20 19:01:07.421502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.421470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:07.421924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.421514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:07.421924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.421514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:07.421924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:07.421609    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:07.421924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:07.421680    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:07.421924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:07.421809    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:07.531146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.531110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:01:07.531810 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.531791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:01:07.632830 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.632685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:01:07.633563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:07.633239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vtjzs"
Jul 20 19:01:08.635711 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.635485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld" event={"ID":"805af851-de16-4d90-b6bf-292c482b5926","Type":"ContainerStarted","Data":"1b9e4f8546c82fd7048d80ed331f6d51b82c949aa34bf5cb350ff1d79198a8d4"}
Jul 20 19:01:08.637229 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.637205    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="2f6cea2f773b25a9aa17918ed87b79ae6a917eedb61481304191b8ad6ada17f3" exitCode=0
Jul 20 19:01:08.637331 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.637293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"2f6cea2f773b25a9aa17918ed87b79ae6a917eedb61481304191b8ad6ada17f3"}
Jul 20 19:01:08.643029 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.643014    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:01:08.643328 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.643307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"a9c41e3da4919a0dd928351950a7420a210f1360b5bcc5839c560c8364301c7e"}
Jul 20 19:01:08.643557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.643542    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:08.643611 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.643592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:08.643706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.643687    2563 scope.go:117] "RemoveContainer" containerID="3c54bd609e1932f7c6c29b2fe59a90cd95589563ccc0e1de4da272cdd8af35d2"
Jul 20 19:01:08.652347 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.652309    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8g9ld" podStartSLOduration=3.378141768 podStartE2EDuration="28.652295884s" totalImagesPullingTime="25.274154116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:08.651711758 +0000 UTC m=+28.833234966" watchObservedRunningTime="2026-07-20 19:01:08.652295884 +0000 UTC m=+28.833819073"
Jul 20 19:01:08.658686 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:08.658668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:09.422058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.421936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:09.422256 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:09.422127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:09.422256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.421976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:09.422256 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:09.422219    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:09.422256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.421969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:09.422472 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:09.422301    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:09.650985 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.650961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:01:09.651703 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.651353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" event={"ID":"9dab84bb-c8b8-411d-ad50-98c9104ca8c8","Type":"ContainerStarted","Data":"fb49e24bbeac7dfbf104a066e7d1b07f613633942d23cb101513880ebd5df5ad"}
Jul 20 19:01:09.651835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.651797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:09.668224 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.668197    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:09.680392 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:09.680285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh" podStartSLOduration=8.817951326 podStartE2EDuration="29.680269907s" totalImagesPullingTime="20.862318581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:09.679359844 +0000 UTC m=+29.860883024" watchObservedRunningTime="2026-07-20 19:01:09.680269907 +0000 UTC m=+29.861793099"
Jul 20 19:01:10.107207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.106981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t5rd"]
Jul 20 19:01:10.107334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.107300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:10.107434 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:10.107415    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:10.110033 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.110006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2mqms"]
Jul 20 19:01:10.110138 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.110105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:10.110233 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:10.110209    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:10.122353 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.122329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p84cn"]
Jul 20 19:01:10.122447 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.122408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:10.122508 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:10.122469    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:10.655701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.655668    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="267de40f606cb155b3b653a17ebccd6e9c8ba08d440fd72da4bf36f7f5b1a382" exitCode=0
Jul 20 19:01:10.656117 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:10.655745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"267de40f606cb155b3b653a17ebccd6e9c8ba08d440fd72da4bf36f7f5b1a382"}
Jul 20 19:01:11.421588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:11.421557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:11.421739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:11.421595    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:11.421739 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:11.421668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:11.421854 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:11.421798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:12.421963 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:12.421937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:12.422426 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:12.422036    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:12.662531 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:12.662500    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="04e3c6041368bf9c5a4076a06c9a3d22e2514376db9311b4f9c7b753b028a2af" exitCode=0
Jul 20 19:01:12.662669 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:12.662567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"04e3c6041368bf9c5a4076a06c9a3d22e2514376db9311b4f9c7b753b028a2af"}
Jul 20 19:01:12.973679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:12.973587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:12.973855 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:12.973738    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:12.973855 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:12.973747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:12.973855 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:12.973820    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret podName:9d53abec-004c-4159-b75d-8186ce8fb603 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:44.973804093 +0000 UTC m=+65.155327260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret") pod "global-pull-secret-syncer-8t5rd" (UID: "9d53abec-004c-4159-b75d-8186ce8fb603") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:12.973855 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:12.973837    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:12.973991 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:12.973885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs podName:2d98a244-009f-4dd6-be61-c588d549bbb7 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:44.973870838 +0000 UTC m=+65.155394018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs") pod "network-metrics-daemon-2mqms" (UID: "2d98a244-009f-4dd6-be61-c588d549bbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:13.074531 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:13.074500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:13.074664 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.074627    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:01:13.074664 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.074641    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:01:13.074664 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.074650    2563 projected.go:196] Error preparing data for projected volume kube-api-access-pnq2z for pod openshift-network-diagnostics/network-check-target-p84cn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:13.074795 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.074695    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z podName:4e5afb9d-646c-4a3f-8b01-ba35046924fb nodeName:}" failed. No retries permitted until 2026-07-20 19:01:45.074680876 +0000 UTC m=+65.256204045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnq2z" (UniqueName: "kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z") pod "network-check-target-p84cn" (UID: "4e5afb9d-646c-4a3f-8b01-ba35046924fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:13.422006 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:13.421977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:13.422446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:13.421978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:13.422446 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.422099    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:13.422446 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:13.422196    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:14.424707 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:14.424638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:14.425130 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:14.424747    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t5rd" podUID="9d53abec-004c-4159-b75d-8186ce8fb603"
Jul 20 19:01:15.421854 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:15.421822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:15.422038 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:15.421828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:15.422038 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:15.421919    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2mqms" podUID="2d98a244-009f-4dd6-be61-c588d549bbb7"
Jul 20 19:01:15.422038 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:15.422017    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p84cn" podUID="4e5afb9d-646c-4a3f-8b01-ba35046924fb"
Jul 20 19:01:16.176184 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.176150    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-117.ec2.internal" event="NodeReady"
Jul 20 19:01:16.176594 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.176306    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:01:16.229374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.229289    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8dhrp"]
Jul 20 19:01:16.231880 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.231861    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vc88l"]
Jul 20 19:01:16.232008 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.231993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.233849 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.233827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.236414 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.236398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:01:16.236587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.236507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tjwjb\""
Jul 20 19:01:16.236705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.236587    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:01:16.236979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.236961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:01:16.237371 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.237354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:01:16.237449 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.237409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:16.237711 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.237692    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:01:16.246178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.246160    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dhrp"]
Jul 20 19:01:16.246989 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.246967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vc88l"]
Jul 20 19:01:16.401946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.401912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5556ad11-00a2-46db-8319-4b4a546eac0c-tmp-dir\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.401946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.401948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5556ad11-00a2-46db-8319-4b4a546eac0c-config-volume\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.402157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.401973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzg2\" (UniqueName: \"kubernetes.io/projected/5556ad11-00a2-46db-8319-4b4a546eac0c-kube-api-access-pmzg2\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.402157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.402004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.402157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.402027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-cert\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.402157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.402067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhfg\" (UniqueName: \"kubernetes.io/projected/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-kube-api-access-dqhfg\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.422020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.421988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:16.424974 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.424950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:01:16.503363 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-cert\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.503534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhfg\" (UniqueName: \"kubernetes.io/projected/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-kube-api-access-dqhfg\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.503534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5556ad11-00a2-46db-8319-4b4a546eac0c-tmp-dir\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.503534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5556ad11-00a2-46db-8319-4b4a546eac0c-config-volume\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.503534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzg2\" (UniqueName: \"kubernetes.io/projected/5556ad11-00a2-46db-8319-4b4a546eac0c-kube-api-access-pmzg2\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.503735 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.503541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.503735 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:16.503655    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.503735 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:16.503710    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:17.003691224 +0000 UTC m=+37.185214393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.504211 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.504181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5556ad11-00a2-46db-8319-4b4a546eac0c-config-volume\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.504211 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.504194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5556ad11-00a2-46db-8319-4b4a546eac0c-tmp-dir\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.508827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.508802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-cert\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.512574 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.512427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzg2\" (UniqueName: \"kubernetes.io/projected/5556ad11-00a2-46db-8319-4b4a546eac0c-kube-api-access-pmzg2\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:16.512689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.512624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhfg\" (UniqueName: \"kubernetes.io/projected/1a1e27eb-df84-4f49-ad7c-264867e7d0bb-kube-api-access-dqhfg\") pod \"ingress-canary-8dhrp\" (UID: \"1a1e27eb-df84-4f49-ad7c-264867e7d0bb\") " pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:16.545400 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:16.545374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8dhrp"
Jul 20 19:01:17.006702 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.006663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:17.006904 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:17.006799    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:17.006904 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:17.006876    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.006855779 +0000 UTC m=+38.188378947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:17.421949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.421702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:17.422396 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.421716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:17.426356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.426330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:17.426356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.426351    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:01:17.426536 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.426338    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:01:17.426536 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.426352    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:17.426536 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.426339    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:17.593978 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.593951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8dhrp"]
Jul 20 19:01:17.597232 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:17.597205    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1e27eb_df84_4f49_ad7c_264867e7d0bb.slice/crio-2f821d0fd2dd3fae41891e73292a8bf4cd37a5a58b5e245436198c91f1e10574 WatchSource:0}: Error finding container 2f821d0fd2dd3fae41891e73292a8bf4cd37a5a58b5e245436198c91f1e10574: Status 404 returned error can't find the container with id 2f821d0fd2dd3fae41891e73292a8bf4cd37a5a58b5e245436198c91f1e10574
Jul 20 19:01:17.675728 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.675695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dhrp" event={"ID":"1a1e27eb-df84-4f49-ad7c-264867e7d0bb","Type":"ContainerStarted","Data":"2f821d0fd2dd3fae41891e73292a8bf4cd37a5a58b5e245436198c91f1e10574"}
Jul 20 19:01:17.679058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:17.679034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerStarted","Data":"59ad5622f3dee1573c4e6a93c14d1e28de664c6578d3b79387ac39ff4729c420"}
Jul 20 19:01:18.013931 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:18.013897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:18.014070 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:18.014006    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:18.014125 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:18.014105    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:20.014087554 +0000 UTC m=+40.195610722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:18.683665 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:18.683635    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="59ad5622f3dee1573c4e6a93c14d1e28de664c6578d3b79387ac39ff4729c420" exitCode=0
Jul 20 19:01:18.684315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:18.683670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"59ad5622f3dee1573c4e6a93c14d1e28de664c6578d3b79387ac39ff4729c420"}
Jul 20 19:01:19.690233 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:19.690198    2563 generic.go:356] "Generic (PLEG): container finished" podID="2271c277-e9bc-40a1-a143-dca573b3acfa" containerID="2f25be32d40ff813f7116536e783f480cb3418bc5ab757a02d41bdec9e31061e" exitCode=0
Jul 20 19:01:19.690593 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:19.690290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerDied","Data":"2f25be32d40ff813f7116536e783f480cb3418bc5ab757a02d41bdec9e31061e"}
Jul 20 19:01:20.030550 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:20.030516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:20.030708 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:20.030686    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:20.030807 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:20.030783    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:24.030745736 +0000 UTC m=+44.212268918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:20.695841 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:20.695805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6v25" event={"ID":"2271c277-e9bc-40a1-a143-dca573b3acfa","Type":"ContainerStarted","Data":"18100a13f765b63ac7e5b0cb3d9b7f6a1c80e9e4cf8c57b6d24d61bea746cbe9"}
Jul 20 19:01:20.721676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:20.721628    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6v25" podStartSLOduration=9.756409486999999 podStartE2EDuration="40.72161226s" totalImagesPullingTime="30.965202773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:20.721323284 +0000 UTC m=+40.902846475" watchObservedRunningTime="2026-07-20 19:01:20.72161226 +0000 UTC m=+40.903135452"
Jul 20 19:01:21.699462 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:21.699423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8dhrp" event={"ID":"1a1e27eb-df84-4f49-ad7c-264867e7d0bb","Type":"ContainerStarted","Data":"c1465ec0301405126bfbb94080d80990c865c226bba680b3fdc68240e8675676"}
Jul 20 19:01:21.715380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:21.715331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8dhrp" podStartSLOduration=2.232054647 podStartE2EDuration="5.715317768s" totalImagesPullingTime="3.483263121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:21.714627363 +0000 UTC m=+41.896150585" watchObservedRunningTime="2026-07-20 19:01:21.715317768 +0000 UTC m=+41.896840935"
Jul 20 19:01:24.058748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:24.058707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:24.059133 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:24.058829    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:24.059133 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:24.058883    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:32.058869912 +0000 UTC m=+52.240393080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:25.381036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.381002    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x5rvt"]
Jul 20 19:01:25.403259 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.403237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5rvt"]
Jul 20 19:01:25.403369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.403354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.406190 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.406166    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:01:25.406291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.406194    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:01:25.406291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.406203    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:25.407352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.407337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:01:25.407352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.407347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:01:25.570290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.570263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887948ab-d6b3-44b5-b536-65060ab1ef14-data-volume\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.570290 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.570290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.570459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.570321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qml\" (UniqueName: \"kubernetes.io/projected/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-api-access-x2qml\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.570459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.570395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887948ab-d6b3-44b5-b536-65060ab1ef14-crio-socket\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.570459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.570423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671465 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887948ab-d6b3-44b5-b536-65060ab1ef14-crio-socket\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671594 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887948ab-d6b3-44b5-b536-65060ab1ef14-data-volume\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/887948ab-d6b3-44b5-b536-65060ab1ef14-crio-socket\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.671718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qml\" (UniqueName: \"kubernetes.io/projected/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-api-access-x2qml\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.671829 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:25.671733    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.671924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:25.671837    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.171817729 +0000 UTC m=+46.353340900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.672065 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:25.672045    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.672140 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:25.672127    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.172093331 +0000 UTC m=+46.353616510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.672324 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.672302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/887948ab-d6b3-44b5-b536-65060ab1ef14-data-volume\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:25.680205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:25.680181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qml\" (UniqueName: \"kubernetes.io/projected/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-api-access-x2qml\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:26.175405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.175365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:26.175605 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.175459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:26.175605 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:26.175528    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.175605 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:26.175546    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.175701 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:26.175614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.1755979 +0000 UTC m=+47.357121071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.175701 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:26.175630    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.175624045 +0000 UTC m=+47.357147213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.489678 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.489609    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"]
Jul 20 19:01:26.513934 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.513906    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"]
Jul 20 19:01:26.514074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.513911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"
Jul 20 19:01:26.516923 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.516882    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:26.517040 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.516958    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 19:01:26.518394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.518369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v2gxj\""
Jul 20 19:01:26.678428 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.678403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcs7m\" (UniqueName: \"kubernetes.io/projected/2cd67e06-346e-4658-b23c-9af2ccd3a4e9-kube-api-access-lcs7m\") pod \"migrator-7cc9c7ffd7-kf2t8\" (UID: \"2cd67e06-346e-4658-b23c-9af2ccd3a4e9\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"
Jul 20 19:01:26.779673 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.779650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcs7m\" (UniqueName: \"kubernetes.io/projected/2cd67e06-346e-4658-b23c-9af2ccd3a4e9-kube-api-access-lcs7m\") pod \"migrator-7cc9c7ffd7-kf2t8\" (UID: \"2cd67e06-346e-4658-b23c-9af2ccd3a4e9\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"
Jul 20 19:01:26.787828 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.787799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcs7m\" (UniqueName: \"kubernetes.io/projected/2cd67e06-346e-4658-b23c-9af2ccd3a4e9-kube-api-access-lcs7m\") pod \"migrator-7cc9c7ffd7-kf2t8\" (UID: \"2cd67e06-346e-4658-b23c-9af2ccd3a4e9\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"
Jul 20 19:01:26.823108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.823086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"
Jul 20 19:01:26.955475 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:26.955446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8"]
Jul 20 19:01:26.958374 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:26.958346    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd67e06_346e_4658_b23c_9af2ccd3a4e9.slice/crio-d68ad010c1131de8e296341afea07b2c71194d824362717c0fe0690bfcf794a3 WatchSource:0}: Error finding container d68ad010c1131de8e296341afea07b2c71194d824362717c0fe0690bfcf794a3: Status 404 returned error can't find the container with id d68ad010c1131de8e296341afea07b2c71194d824362717c0fe0690bfcf794a3
Jul 20 19:01:27.182799 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:27.182685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:27.182799 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:27.182781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:27.183024 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:27.182827    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.183024 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:27.182894    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.182878845 +0000 UTC m=+49.364402012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.183024 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:27.182913    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.183024 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:27.182970    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.182954941 +0000 UTC m=+49.364478126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.387281 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:27.387250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r92cd_ab6e36f0-2426-4402-bdb6-f0d09978aeda/dns-node-resolver/0.log"
Jul 20 19:01:27.713788 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:27.713737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8" event={"ID":"2cd67e06-346e-4658-b23c-9af2ccd3a4e9","Type":"ContainerStarted","Data":"d68ad010c1131de8e296341afea07b2c71194d824362717c0fe0690bfcf794a3"}
Jul 20 19:01:28.187006 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.186979    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wrwq_ed7c12d2-c7df-4da6-a842-a2b60e7cdd92/node-ca/0.log"
Jul 20 19:01:28.641597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.641562    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qrvm7"]
Jul 20 19:01:28.656365 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.656333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.658231 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.658203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qrvm7"]
Jul 20 19:01:28.659269 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.659245    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 19:01:28.659368 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.659255    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 19:01:28.660523 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.660502    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 19:01:28.660744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.660730    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 19:01:28.660870 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.660850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ndd2g\""
Jul 20 19:01:28.695310 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.695290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shchf\" (UniqueName: \"kubernetes.io/projected/d10c3848-f7e4-4735-b21b-93efcf806ded-kube-api-access-shchf\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.695401 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.695343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-key\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.695401 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.695363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-cabundle\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.796561 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.796537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-key\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.796866 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.796577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-cabundle\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.796866 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.796686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shchf\" (UniqueName: \"kubernetes.io/projected/d10c3848-f7e4-4735-b21b-93efcf806ded-kube-api-access-shchf\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.797137 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.797121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-cabundle\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.798845 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.798828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10c3848-f7e4-4735-b21b-93efcf806ded-signing-key\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.804599 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.804572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shchf\" (UniqueName: \"kubernetes.io/projected/d10c3848-f7e4-4735-b21b-93efcf806ded-kube-api-access-shchf\") pod \"service-ca-58598695f7-qrvm7\" (UID: \"d10c3848-f7e4-4735-b21b-93efcf806ded\") " pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.966496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.966471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qrvm7"
Jul 20 19:01:28.986790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:28.986711    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8dhrp_1a1e27eb-df84-4f49-ad7c-264867e7d0bb/serve-healthcheck-canary/0.log"
Jul 20 19:01:29.107978 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.107950    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qrvm7"]
Jul 20 19:01:29.111399 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:29.111371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10c3848_f7e4_4735_b21b_93efcf806ded.slice/crio-a8c6055e550d0e17d04a7681fbfeedfd6906c60d23311c229382f9098efb4995 WatchSource:0}: Error finding container a8c6055e550d0e17d04a7681fbfeedfd6906c60d23311c229382f9098efb4995: Status 404 returned error can't find the container with id a8c6055e550d0e17d04a7681fbfeedfd6906c60d23311c229382f9098efb4995
Jul 20 19:01:29.200381 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.200316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:29.200483 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.200420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:29.200624 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:29.200596    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.200683 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:29.200664    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.200645879 +0000 UTC m=+53.382169064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.201117 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:29.201100    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.201194 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:29.201162    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.201145775 +0000 UTC m=+53.382668943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.720315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.720271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qrvm7" event={"ID":"d10c3848-f7e4-4735-b21b-93efcf806ded","Type":"ContainerStarted","Data":"a8c6055e550d0e17d04a7681fbfeedfd6906c60d23311c229382f9098efb4995"}
Jul 20 19:01:29.722406 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.722375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8" event={"ID":"2cd67e06-346e-4658-b23c-9af2ccd3a4e9","Type":"ContainerStarted","Data":"65868340909f9ce8b48f5242dba5116cdb925c0f89d192f7c791d10d4590d24b"}
Jul 20 19:01:29.722529 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:29.722424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8" event={"ID":"2cd67e06-346e-4658-b23c-9af2ccd3a4e9","Type":"ContainerStarted","Data":"aa04547c1554cadb5dc5dddbe9ce4998e67d2b9985ac2d9ccf7dae18c8999140"}
Jul 20 19:01:32.124828 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:32.124799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:32.125191 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:32.124900    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:32.125191 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:32.124949    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls podName:5556ad11-00a2-46db-8319-4b4a546eac0c nodeName:}" failed. No retries permitted until 2026-07-20 19:01:48.12493578 +0000 UTC m=+68.306458948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls") pod "dns-default-vc88l" (UID: "5556ad11-00a2-46db-8319-4b4a546eac0c") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:32.730788 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:32.730736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qrvm7" event={"ID":"d10c3848-f7e4-4735-b21b-93efcf806ded","Type":"ContainerStarted","Data":"c6c79e14cca6701b9dcb95645722b2a1a8705c3ecc1a5a942b855b7cc51e1c8e"}
Jul 20 19:01:32.751341 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:32.751286    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-qrvm7" podStartSLOduration=2.185231184 podStartE2EDuration="4.751263302s" totalImagesPullingTime="2.566032118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:32.750816114 +0000 UTC m=+52.932339306" watchObservedRunningTime="2026-07-20 19:01:32.751263302 +0000 UTC m=+52.932786493"
Jul 20 19:01:32.751578 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:32.751552    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-kf2t8" podStartSLOduration=4.968512148 podStartE2EDuration="6.751546127s" totalImagesPullingTime="1.783033979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:29.743875841 +0000 UTC m=+49.925399045" watchObservedRunningTime="2026-07-20 19:01:32.751546127 +0000 UTC m=+52.933069321"
Jul 20 19:01:33.233860 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:33.233828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:33.234369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:33.233900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:33.234369 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:33.234005    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.234369 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:01:33.234088    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls podName:887948ab-d6b3-44b5-b536-65060ab1ef14 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:41.234064672 +0000 UTC m=+61.415587861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x5rvt" (UID: "887948ab-d6b3-44b5-b536-65060ab1ef14") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.234369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:33.234354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/887948ab-d6b3-44b5-b536-65060ab1ef14-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:41.296689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.296632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:41.309879 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.309849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/887948ab-d6b3-44b5-b536-65060ab1ef14-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x5rvt\" (UID: \"887948ab-d6b3-44b5-b536-65060ab1ef14\") " pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:41.314838 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.314816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:41.322143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.322125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x5rvt"
Jul 20 19:01:41.505843 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.505815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x5rvt"]
Jul 20 19:01:41.509004 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:41.508967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887948ab_d6b3_44b5_b536_65060ab1ef14.slice/crio-22e90dffe4e4b3d4315ba65abceb2a641fe48468a3257336aebeb55049d73844 WatchSource:0}: Error finding container 22e90dffe4e4b3d4315ba65abceb2a641fe48468a3257336aebeb55049d73844: Status 404 returned error can't find the container with id 22e90dffe4e4b3d4315ba65abceb2a641fe48468a3257336aebeb55049d73844
Jul 20 19:01:41.674200 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.674132    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8mmzh"
Jul 20 19:01:41.753344 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:41.753313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5rvt" event={"ID":"887948ab-d6b3-44b5-b536-65060ab1ef14","Type":"ContainerStarted","Data":"22e90dffe4e4b3d4315ba65abceb2a641fe48468a3257336aebeb55049d73844"}
Jul 20 19:01:45.024508 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.024461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:45.024991 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.024543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:45.027360 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.027332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:01:45.027503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.027379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:45.038384 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.038073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d98a244-009f-4dd6-be61-c588d549bbb7-metrics-certs\") pod \"network-metrics-daemon-2mqms\" (UID: \"2d98a244-009f-4dd6-be61-c588d549bbb7\") " pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:45.038384 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.038120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d53abec-004c-4159-b75d-8186ce8fb603-original-pull-secret\") pod \"global-pull-secret-syncer-8t5rd\" (UID: \"9d53abec-004c-4159-b75d-8186ce8fb603\") " pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:45.041454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.041436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:45.050048 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.050026    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2mqms"
Jul 20 19:01:45.125286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.125251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:45.128410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.128385    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:01:45.137949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.137929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:01:45.148678 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.148656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnq2z\" (UniqueName: \"kubernetes.io/projected/4e5afb9d-646c-4a3f-8b01-ba35046924fb-kube-api-access-pnq2z\") pod \"network-check-target-p84cn\" (UID: \"4e5afb9d-646c-4a3f-8b01-ba35046924fb\") " pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:45.231942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.231910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t5rd"
Jul 20 19:01:45.336385 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.336311    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:45.344582 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:45.344558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:47.234224 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.234197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2mqms"]
Jul 20 19:01:47.237338 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:47.237296    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d98a244_009f_4dd6_be61_c588d549bbb7.slice/crio-ed232475a59f769385903ffa4ef0120a7e4cccee627bff08221538b62431bace WatchSource:0}: Error finding container ed232475a59f769385903ffa4ef0120a7e4cccee627bff08221538b62431bace: Status 404 returned error can't find the container with id ed232475a59f769385903ffa4ef0120a7e4cccee627bff08221538b62431bace
Jul 20 19:01:47.453620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.453546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t5rd"]
Jul 20 19:01:47.456709 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:47.456681    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d53abec_004c_4159_b75d_8186ce8fb603.slice/crio-10c9c765c55875c94f8a568ac47e5f55074e932203da27c463ebfba18db920ee WatchSource:0}: Error finding container 10c9c765c55875c94f8a568ac47e5f55074e932203da27c463ebfba18db920ee: Status 404 returned error can't find the container with id 10c9c765c55875c94f8a568ac47e5f55074e932203da27c463ebfba18db920ee
Jul 20 19:01:47.457251 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.457214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p84cn"]
Jul 20 19:01:47.459869 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:47.459850    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5afb9d_646c_4a3f_8b01_ba35046924fb.slice/crio-e3214abdfa0b7c65b285a7d5dd2d456ee38ee046a60a504f8293f8f35c79265a WatchSource:0}: Error finding container e3214abdfa0b7c65b285a7d5dd2d456ee38ee046a60a504f8293f8f35c79265a: Status 404 returned error can't find the container with id e3214abdfa0b7c65b285a7d5dd2d456ee38ee046a60a504f8293f8f35c79265a
Jul 20 19:01:47.775650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.775602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2mqms" event={"ID":"2d98a244-009f-4dd6-be61-c588d549bbb7","Type":"ContainerStarted","Data":"ed232475a59f769385903ffa4ef0120a7e4cccee627bff08221538b62431bace"}
Jul 20 19:01:47.777168 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.777094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p84cn" event={"ID":"4e5afb9d-646c-4a3f-8b01-ba35046924fb","Type":"ContainerStarted","Data":"e3214abdfa0b7c65b285a7d5dd2d456ee38ee046a60a504f8293f8f35c79265a"}
Jul 20 19:01:47.778740 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.778709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t5rd" event={"ID":"9d53abec-004c-4159-b75d-8186ce8fb603","Type":"ContainerStarted","Data":"10c9c765c55875c94f8a568ac47e5f55074e932203da27c463ebfba18db920ee"}
Jul 20 19:01:47.780565 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:47.780507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5rvt" event={"ID":"887948ab-d6b3-44b5-b536-65060ab1ef14","Type":"ContainerStarted","Data":"efea5df77ffcc3555d48775d9338df7f8dfe40631a70b634018127801c834223"}
Jul 20 19:01:48.150037 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:48.149465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:48.154226 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:48.154173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5556ad11-00a2-46db-8319-4b4a546eac0c-metrics-tls\") pod \"dns-default-vc88l\" (UID: \"5556ad11-00a2-46db-8319-4b4a546eac0c\") " pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:48.354956 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:48.354930    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:48.362542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:48.362517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:48.801042 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:48.800976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vc88l"]
Jul 20 19:01:48.950822 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:48.949959    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5556ad11_00a2_46db_8319_4b4a546eac0c.slice/crio-4fc641a550df5806896376e065bd41950868a54ab4a5a0b2afe1e2a915c466ed WatchSource:0}: Error finding container 4fc641a550df5806896376e065bd41950868a54ab4a5a0b2afe1e2a915c466ed: Status 404 returned error can't find the container with id 4fc641a550df5806896376e065bd41950868a54ab4a5a0b2afe1e2a915c466ed
Jul 20 19:01:49.790853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:49.790728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vc88l" event={"ID":"5556ad11-00a2-46db-8319-4b4a546eac0c","Type":"ContainerStarted","Data":"4fc641a550df5806896376e065bd41950868a54ab4a5a0b2afe1e2a915c466ed"}
Jul 20 19:01:49.792863 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:49.792803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2mqms" event={"ID":"2d98a244-009f-4dd6-be61-c588d549bbb7","Type":"ContainerStarted","Data":"f2c43297437570f500984d9a72a1f5b965b7e0c8199ecdaafca60bd15dd07d62"}
Jul 20 19:01:54.288750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.288706    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"]
Jul 20 19:01:54.292305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.292282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.295573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.295297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 19:01:54.295573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.295567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 19:01:54.296615 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.296587    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 19:01:54.296713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.296624    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 19:01:54.296713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.296652    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 19:01:54.296905 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.296890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 19:01:54.297261 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.297185    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 19:01:54.328338 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.328291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"]
Jul 20 19:01:54.398210 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.398320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.398320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.398320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.398489 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97s8\" (UniqueName: \"kubernetes.io/projected/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-kube-api-access-l97s8\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.398489 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.398386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97s8\" (UniqueName: \"kubernetes.io/projected/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-kube-api-access-l97s8\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.499395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.498964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.500410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.500349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.504418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.504387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.504563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.504537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.504965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.504925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-hub\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.504965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.504940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-ca\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.525768 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.525735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97s8\" (UniqueName: \"kubernetes.io/projected/2c1de4c9-4d73-4b0d-a53d-2b9439704b85-kube-api-access-l97s8\") pod \"cluster-proxy-proxy-agent-69c9d4857c-5gxgn\" (UID: \"2c1de4c9-4d73-4b0d-a53d-2b9439704b85\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.609152 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.609124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"
Jul 20 19:01:54.743065 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.743031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn"]
Jul 20 19:01:54.745670 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:01:54.745645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1de4c9_4d73_4b0d_a53d_2b9439704b85.slice/crio-f7e79f0ec2dd08876ae90075ac150e16551b0fbf0bf9b8c883d908f6b476fd30 WatchSource:0}: Error finding container f7e79f0ec2dd08876ae90075ac150e16551b0fbf0bf9b8c883d908f6b476fd30: Status 404 returned error can't find the container with id f7e79f0ec2dd08876ae90075ac150e16551b0fbf0bf9b8c883d908f6b476fd30
Jul 20 19:01:54.810929 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.810854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5rvt" event={"ID":"887948ab-d6b3-44b5-b536-65060ab1ef14","Type":"ContainerStarted","Data":"c4b18dc7a1f688c7e3ad6a0b1d0eb7f99f1801e4733d7505c8a276f3a3246d51"}
Jul 20 19:01:54.812551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.812530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vc88l" event={"ID":"5556ad11-00a2-46db-8319-4b4a546eac0c","Type":"ContainerStarted","Data":"78f8bb5fa5196a7fbf98b60b3805621e75826ba9ad7e3c7291171454c5a375b7"}
Jul 20 19:01:54.812667 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.812570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vc88l" event={"ID":"5556ad11-00a2-46db-8319-4b4a546eac0c","Type":"ContainerStarted","Data":"4163dbe7a6f4d5eec280b199c135fbf00600702aa8db1123912e3982bdc32758"}
Jul 20 19:01:54.812667 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.812645    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vc88l"
Jul 20 19:01:54.814244 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.814223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2mqms" event={"ID":"2d98a244-009f-4dd6-be61-c588d549bbb7","Type":"ContainerStarted","Data":"7b6b48275668d172560cbe7572531699efbaa63033edc584e3a43d96b6fe264c"}
Jul 20 19:01:54.815558 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.815539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p84cn" event={"ID":"4e5afb9d-646c-4a3f-8b01-ba35046924fb","Type":"ContainerStarted","Data":"dc67bfab49bccdc027919a060410a9a32e7dbef2066722c496f67c8d6d83220d"}
Jul 20 19:01:54.815643 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.815585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:01:54.816833 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.816815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t5rd" event={"ID":"9d53abec-004c-4159-b75d-8186ce8fb603","Type":"ContainerStarted","Data":"ab88ffaa7f8561f9ad9c9200ce0e2f00c3973975a919122fe70984bfdb06418b"}
Jul 20 19:01:54.817746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.817725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn" event={"ID":"2c1de4c9-4d73-4b0d-a53d-2b9439704b85","Type":"ContainerStarted","Data":"f7e79f0ec2dd08876ae90075ac150e16551b0fbf0bf9b8c883d908f6b476fd30"}
Jul 20 19:01:54.838622 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.838585    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vc88l" podStartSLOduration=33.44770071 podStartE2EDuration="38.838571645s" totalImagesPullingTime="5.390870935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.838026066 +0000 UTC m=+75.019549297" watchObservedRunningTime="2026-07-20 19:01:54.838571645 +0000 UTC m=+75.020094870"
Jul 20 19:01:54.861711 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.861669    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2mqms" podStartSLOduration=73.12244006 podStartE2EDuration="1m14.861656314s" totalImagesPullingTime="1.739216254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.861318762 +0000 UTC m=+75.042841953" watchObservedRunningTime="2026-07-20 19:01:54.861656314 +0000 UTC m=+75.043179503"
Jul 20 19:01:54.882823 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.882786    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p84cn" podStartSLOduration=68.028176646 podStartE2EDuration="1m14.882776564s" totalImagesPullingTime="6.854599918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.882171033 +0000 UTC m=+75.063694234" watchObservedRunningTime="2026-07-20 19:01:54.882776564 +0000 UTC m=+75.064299750"
Jul 20 19:01:54.903942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:54.903909    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8t5rd" podStartSLOduration=68.046046046 podStartE2EDuration="1m14.903897481s" totalImagesPullingTime="6.857851435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.903385246 +0000 UTC m=+75.084908456" watchObservedRunningTime="2026-07-20 19:01:54.903897481 +0000 UTC m=+75.085420669"
Jul 20 19:01:59.525822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.525786    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"]
Jul 20 19:01:59.538929 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.538894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"]
Jul 20 19:01:59.539082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.539029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.542446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.542253    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:01:59.542576 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.542472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 19:01:59.542710 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.542686    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:01:59.543158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.543142    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:01:59.543231 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.543190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pgfnr\""
Jul 20 19:01:59.543291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.543142    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 19:01:59.637139 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.637099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.637312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.637164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a14c6d-3651-470e-acdd-fa77ac3533ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.637312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.637224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.637312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.637275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8l2\" (UniqueName: \"kubernetes.io/projected/35a14c6d-3651-470e-acdd-fa77ac3533ca-kube-api-access-jj8l2\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.738692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.738658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a14c6d-3651-470e-acdd-fa77ac3533ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.738908 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.738718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.738908 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.738779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8l2\" (UniqueName: \"kubernetes.io/projected/35a14c6d-3651-470e-acdd-fa77ac3533ca-kube-api-access-jj8l2\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.738908 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.738822    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.739575 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.739546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a14c6d-3651-470e-acdd-fa77ac3533ca-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.741476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.741448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.741585 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.741567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35a14c6d-3651-470e-acdd-fa77ac3533ca-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.746978 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.746933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8l2\" (UniqueName: \"kubernetes.io/projected/35a14c6d-3651-470e-acdd-fa77ac3533ca-kube-api-access-jj8l2\") pod \"prometheus-operator-5945b5cfd-5vpfd\" (UID: \"35a14c6d-3651-470e-acdd-fa77ac3533ca\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:01:59.851063 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:01:59.850985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"
Jul 20 19:02:00.116627 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.116590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd"]
Jul 20 19:02:00.118804 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:02:00.118777    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a14c6d_3651_470e_acdd_fa77ac3533ca.slice/crio-448f3f16422facebe020023574fa13ed27ce59cd377755dee7a6a8e040367a73 WatchSource:0}: Error finding container 448f3f16422facebe020023574fa13ed27ce59cd377755dee7a6a8e040367a73: Status 404 returned error can't find the container with id 448f3f16422facebe020023574fa13ed27ce59cd377755dee7a6a8e040367a73
Jul 20 19:02:00.845133 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.845091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn" event={"ID":"2c1de4c9-4d73-4b0d-a53d-2b9439704b85","Type":"ContainerStarted","Data":"1d0cab1c4a119e3b9562f6a06553d9ba97f7410c5354e4a306c8a373a1f8ca4b"}
Jul 20 19:02:00.845591 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.845147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn" event={"ID":"2c1de4c9-4d73-4b0d-a53d-2b9439704b85","Type":"ContainerStarted","Data":"70d0c7fabf32fe2094857a6caa4dadadab32ba58a2397ea1dfb6d430f971c9fd"}
Jul 20 19:02:00.845591 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.845167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn" event={"ID":"2c1de4c9-4d73-4b0d-a53d-2b9439704b85","Type":"ContainerStarted","Data":"72bed5b8008f748509a12c0d21f5a40903c7eb63ed00febd96679b69c3388372"}
Jul 20 19:02:00.846509 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.846480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd" event={"ID":"35a14c6d-3651-470e-acdd-fa77ac3533ca","Type":"ContainerStarted","Data":"448f3f16422facebe020023574fa13ed27ce59cd377755dee7a6a8e040367a73"}
Jul 20 19:02:00.848811 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.848781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x5rvt" event={"ID":"887948ab-d6b3-44b5-b536-65060ab1ef14","Type":"ContainerStarted","Data":"4ba936e128d9b2b5ca6e683758ca415cf4e3187b983d3db00ce814c40fbd0c7b"}
Jul 20 19:02:00.864770 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.864687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69c9d4857c-5gxgn" podStartSLOduration=1.612353629 podStartE2EDuration="6.864667426s" totalImagesPullingTime="5.252313797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:00.863515627 +0000 UTC m=+81.045038817" watchObservedRunningTime="2026-07-20 19:02:00.864667426 +0000 UTC m=+81.046190619"
Jul 20 19:02:00.887726 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:00.887667    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x5rvt" podStartSLOduration=17.586987871 podStartE2EDuration="35.887647457s" totalImagesPullingTime="18.300659586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:01:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:00.886620338 +0000 UTC m=+81.068143528" watchObservedRunningTime="2026-07-20 19:02:00.887647457 +0000 UTC m=+81.069170646"
Jul 20 19:02:01.853470 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:01.853296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd" event={"ID":"35a14c6d-3651-470e-acdd-fa77ac3533ca","Type":"ContainerStarted","Data":"7e10c6972ec036494c95a8433b2fe82ec0957c000dba644ed3602b444236d806"}
Jul 20 19:02:01.853470 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:01.853364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd" event={"ID":"35a14c6d-3651-470e-acdd-fa77ac3533ca","Type":"ContainerStarted","Data":"e61ab8e03e85f150bb47aac4e3de4d6c8f01260008890873eb139bd02a5dde31"}
Jul 20 19:02:01.873832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:01.873783    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5vpfd" podStartSLOduration=1.485180341 podStartE2EDuration="2.873748304s" totalImagesPullingTime="1.388567963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:01.872350085 +0000 UTC m=+82.053873288" watchObservedRunningTime="2026-07-20 19:02:01.873748304 +0000 UTC m=+82.055271494"
Jul 20 19:02:03.944853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.944819    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b2k78"]
Jul 20 19:02:03.949434 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.949412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:03.959861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.959836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:02:03.959970 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.959894    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:02:03.965148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.965134    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9chdd\""
Jul 20 19:02:03.965562 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:03.965544    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:02:04.055071 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.055034    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"]
Jul 20 19:02:04.058633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.058607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.062305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.062283    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 19:02:04.062305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.062297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bwncb\""
Jul 20 19:02:04.064705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.064685    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 19:02:04.065981 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.065963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-wtmp\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-textfile\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066164 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-root\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-sys\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96dvv\" (UniqueName: \"kubernetes.io/projected/5f13897e-0ed4-411b-885f-556c86cda224-kube-api-access-96dvv\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066581 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066581 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-tls\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.066581 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.066384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-metrics-client-ca\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.090350 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.090325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"]
Jul 20 19:02:04.167042 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5da54037-7824-4acd-8f1d-25e7f430e778-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-root\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-sys\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96dvv\" (UniqueName: \"kubernetes.io/projected/5f13897e-0ed4-411b-885f-556c86cda224-kube-api-access-96dvv\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-root\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-sys\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrr5t\" (UniqueName: \"kubernetes.io/projected/5da54037-7824-4acd-8f1d-25e7f430e778-kube-api-access-zrr5t\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-tls\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-metrics-client-ca\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-wtmp\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-textfile\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.167637 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-wtmp\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.168006 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.167684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-textfile\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.168121 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.168100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-metrics-client-ca\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.168179 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.168121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.169783 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.169730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-tls\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.170034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.170015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f13897e-0ed4-411b-885f-556c86cda224-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.179982 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.179960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96dvv\" (UniqueName: \"kubernetes.io/projected/5f13897e-0ed4-411b-885f-556c86cda224-kube-api-access-96dvv\") pod \"node-exporter-b2k78\" (UID: \"5f13897e-0ed4-411b-885f-556c86cda224\") " pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.261560 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.261527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2k78"
Jul 20 19:02:04.267968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.267945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5da54037-7824-4acd-8f1d-25e7f430e778-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.268064 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.267990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.268154 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.268130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.268232 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.268211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrr5t\" (UniqueName: \"kubernetes.io/projected/5da54037-7824-4acd-8f1d-25e7f430e778-kube-api-access-zrr5t\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.268731 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.268706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5da54037-7824-4acd-8f1d-25e7f430e778-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.270832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.270809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.270960 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.270932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5da54037-7824-4acd-8f1d-25e7f430e778-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.274698 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:02:04.274672    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f13897e_0ed4_411b_885f_556c86cda224.slice/crio-4e795fbdbc9626ca96d436116278b297818f5eb589a3603fa73d89f31bdd9e31 WatchSource:0}: Error finding container 4e795fbdbc9626ca96d436116278b297818f5eb589a3603fa73d89f31bdd9e31: Status 404 returned error can't find the container with id 4e795fbdbc9626ca96d436116278b297818f5eb589a3603fa73d89f31bdd9e31
Jul 20 19:02:04.277914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.277889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrr5t\" (UniqueName: \"kubernetes.io/projected/5da54037-7824-4acd-8f1d-25e7f430e778-kube-api-access-zrr5t\") pod \"openshift-state-metrics-79f6958cdf-wm7sv\" (UID: \"5da54037-7824-4acd-8f1d-25e7f430e778\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.369374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.369337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"
Jul 20 19:02:04.503293 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.503265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv"]
Jul 20 19:02:04.506073 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:02:04.506041    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da54037_7824_4acd_8f1d_25e7f430e778.slice/crio-8b5bfe8e6c94a658aa0e9434540a0368ba06e736c2b60b218c37a779c892d915 WatchSource:0}: Error finding container 8b5bfe8e6c94a658aa0e9434540a0368ba06e736c2b60b218c37a779c892d915: Status 404 returned error can't find the container with id 8b5bfe8e6c94a658aa0e9434540a0368ba06e736c2b60b218c37a779c892d915
Jul 20 19:02:04.825596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.825522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vc88l"
Jul 20 19:02:04.870051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.870015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv" event={"ID":"5da54037-7824-4acd-8f1d-25e7f430e778","Type":"ContainerStarted","Data":"a5dcfcf3258fab519480c5b41023bff620acc7fe9f6ced91d79f712046c632cf"}
Jul 20 19:02:04.870214 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.870089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv" event={"ID":"5da54037-7824-4acd-8f1d-25e7f430e778","Type":"ContainerStarted","Data":"a993ff33fed777e69336d046f9d07cd0244dd7fa6fb3127d3aa9b593fa6d0fdb"}
Jul 20 19:02:04.870214 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.870121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv" event={"ID":"5da54037-7824-4acd-8f1d-25e7f430e778","Type":"ContainerStarted","Data":"8b5bfe8e6c94a658aa0e9434540a0368ba06e736c2b60b218c37a779c892d915"}
Jul 20 19:02:04.871443 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:04.871343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2k78" event={"ID":"5f13897e-0ed4-411b-885f-556c86cda224","Type":"ContainerStarted","Data":"4e795fbdbc9626ca96d436116278b297818f5eb589a3603fa73d89f31bdd9e31"}
Jul 20 19:02:05.890505 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:05.890473    2563 generic.go:356] "Generic (PLEG): container finished" podID="5f13897e-0ed4-411b-885f-556c86cda224" containerID="37a247a298ed312cec154c2c640f5407c9ae21c9378e62152131d95be1cdf107" exitCode=0
Jul 20 19:02:05.890828 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:05.890551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2k78" event={"ID":"5f13897e-0ed4-411b-885f-556c86cda224","Type":"ContainerDied","Data":"37a247a298ed312cec154c2c640f5407c9ae21c9378e62152131d95be1cdf107"}
Jul 20 19:02:06.900665 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:06.900629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv" event={"ID":"5da54037-7824-4acd-8f1d-25e7f430e778","Type":"ContainerStarted","Data":"410d389967a213474a93fc2e68803003f9bd67530f313e571241c5e6c44d1031"}
Jul 20 19:02:06.902889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:06.902855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2k78" event={"ID":"5f13897e-0ed4-411b-885f-556c86cda224","Type":"ContainerStarted","Data":"a3ea0cfe7cbbfceb8f36c8f0303ff850df19fd8595aa748dc52bd138a7da269f"}
Jul 20 19:02:06.903011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:06.902918    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2k78" event={"ID":"5f13897e-0ed4-411b-885f-556c86cda224","Type":"ContainerStarted","Data":"e9fb2ed531c0a03dc693dd2e84c0c7a347c8917a1c9fb21bf0456ed0a6466931"}
Jul 20 19:02:06.921327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:06.921280    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wm7sv" podStartSLOduration=1.695394253 podStartE2EDuration="2.921266208s" totalImagesPullingTime="1.225871955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:06.919715194 +0000 UTC m=+87.101238395" watchObservedRunningTime="2026-07-20 19:02:06.921266208 +0000 UTC m=+87.102789397"
Jul 20 19:02:06.940667 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:06.940619    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b2k78" podStartSLOduration=2.789468216 podStartE2EDuration="3.940593198s" totalImagesPullingTime="1.079794128s" totalInitContainerRuntime="71.330854ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:06.939211507 +0000 UTC m=+87.120734751" watchObservedRunningTime="2026-07-20 19:02:06.940593198 +0000 UTC m=+87.122116420"
Jul 20 19:02:13.169876 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.169840    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:13.174561 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.174545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.177455 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.177435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 19:02:13.177576 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.177477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 19:02:13.177576 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.177526    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 19:02:13.178890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.178747    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 19:02:13.178890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.178782    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 19:02:13.178890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.178793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gf4mx\""
Jul 20 19:02:13.178890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.178836    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 19:02:13.180265 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.180235    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 19:02:13.189539 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.189518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:13.189539 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.189538    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 19:02:13.337148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhcq\" (UniqueName: \"kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.337299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.337299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438153 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438153 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhcq\" (UniqueName: \"kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438153 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.438418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.439029 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.438999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.439164 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.439137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.439211 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.439152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.439342 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.439325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.440650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.440628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.440799 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.440781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.446434 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.446413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhcq\" (UniqueName: \"kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq\") pod \"console-65d47c4b97-848gw\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") " pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.486871 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.486834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:13.608201 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.608036    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:13.610617 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:02:13.610593    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fb34c0_713f_4602_9a66_0c7507dc8c5c.slice/crio-d24de85401f82ef8758253d56373788d36c0bf515d73793866a83f26071dd1e5 WatchSource:0}: Error finding container d24de85401f82ef8758253d56373788d36c0bf515d73793866a83f26071dd1e5: Status 404 returned error can't find the container with id d24de85401f82ef8758253d56373788d36c0bf515d73793866a83f26071dd1e5
Jul 20 19:02:13.929020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:13.928988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47c4b97-848gw" event={"ID":"72fb34c0-713f-4602-9a66-0c7507dc8c5c","Type":"ContainerStarted","Data":"d24de85401f82ef8758253d56373788d36c0bf515d73793866a83f26071dd1e5"}
Jul 20 19:02:16.942067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:16.942034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47c4b97-848gw" event={"ID":"72fb34c0-713f-4602-9a66-0c7507dc8c5c","Type":"ContainerStarted","Data":"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"}
Jul 20 19:02:16.959642 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:16.959598    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d47c4b97-848gw" podStartSLOduration=0.704382939 podStartE2EDuration="3.959580166s" totalImagesPullingTime="3.255197227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:16.958677817 +0000 UTC m=+97.140201012" watchObservedRunningTime="2026-07-20 19:02:16.959580166 +0000 UTC m=+97.141103354"
Jul 20 19:02:23.487585 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:23.487554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:23.488034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:23.487626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:23.491954 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:23.491934    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:23.972430 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:23.972402    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:25.825971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:25.825943    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p84cn"
Jul 20 19:02:26.407535 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:26.407505    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:51.428403 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.428346    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65d47c4b97-848gw" podUID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" containerName="console" containerID="cri-o://c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61" gracePeriod=15
Jul 20 19:02:51.655285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.655260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:51.699031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.698953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.698991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flhcq\" (UniqueName: \"kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699044    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699089    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.699422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:51.699500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config" (OuterVolumeSpecName: "console-config") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:51.699549 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.699477    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:51.701261 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.701234    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:51.701354 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.701282    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:51.701354 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.701290    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq" (OuterVolumeSpecName: "kube-api-access-flhcq") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "kube-api-access-flhcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:51.799463 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799420    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle\") pod \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\" (UID: \"72fb34c0-713f-4602-9a66-0c7507dc8c5c\") "
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799564    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-config\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799575    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-oauth-serving-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799597    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-serving-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799606    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/72fb34c0-713f-4602-9a66-0c7507dc8c5c-console-oauth-config\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799614    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-service-ca\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799623    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flhcq\" (UniqueName: \"kubernetes.io/projected/72fb34c0-713f-4602-9a66-0c7507dc8c5c-kube-api-access-flhcq\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:51.799973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.799880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "72fb34c0-713f-4602-9a66-0c7507dc8c5c" (UID: "72fb34c0-713f-4602-9a66-0c7507dc8c5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:51.900370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:51.900330    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72fb34c0-713f-4602-9a66-0c7507dc8c5c-trusted-ca-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:02:52.066514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.066481    2563 generic.go:356] "Generic (PLEG): container finished" podID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" containerID="c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61" exitCode=0
Jul 20 19:02:52.066685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.066525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47c4b97-848gw" event={"ID":"72fb34c0-713f-4602-9a66-0c7507dc8c5c","Type":"ContainerDied","Data":"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"}
Jul 20 19:02:52.066685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.066533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d47c4b97-848gw"
Jul 20 19:02:52.066685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.066587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d47c4b97-848gw" event={"ID":"72fb34c0-713f-4602-9a66-0c7507dc8c5c","Type":"ContainerDied","Data":"d24de85401f82ef8758253d56373788d36c0bf515d73793866a83f26071dd1e5"}
Jul 20 19:02:52.066685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.066607    2563 scope.go:117] "RemoveContainer" containerID="c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"
Jul 20 19:02:52.075213 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.075197    2563 scope.go:117] "RemoveContainer" containerID="c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"
Jul 20 19:02:52.075483 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:02:52.075462    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61\": container with ID starting with c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61 not found: ID does not exist" containerID="c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"
Jul 20 19:02:52.075549 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.075495    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61"} err="failed to get container status \"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61\": rpc error: code = NotFound desc = could not find container \"c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61\": container with ID starting with c99664dd368298fef35942d378b0e3a79d239fa68341f486fa0d93a44b0e0c61 not found: ID does not exist"
Jul 20 19:02:52.095012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.093004    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:52.102561 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.102541    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d47c4b97-848gw"]
Jul 20 19:02:52.426258 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:02:52.426176    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" path="/var/lib/kubelet/pods/72fb34c0-713f-4602-9a66-0c7507dc8c5c/volumes"
Jul 20 19:04:20.000573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.000541    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"]
Jul 20 19:04:20.000957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.000809    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" containerName="console"
Jul 20 19:04:20.000957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.000821    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" containerName="console"
Jul 20 19:04:20.000957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.000871    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="72fb34c0-713f-4602-9a66-0c7507dc8c5c" containerName="console"
Jul 20 19:04:20.002563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.002547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.005218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.005189    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:04:20.006361 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.006340    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:04:20.006487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.006377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mnq8k\""
Jul 20 19:04:20.013515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.013496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"]
Jul 20 19:04:20.083461 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.083434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.083579 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.083468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwv2\" (UniqueName: \"kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.083579 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.083490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.183986 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.183962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.184094 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.183992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwv2\" (UniqueName: \"kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.184094 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.184014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.184298 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.184284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.184371 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.184354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.192480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.192455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwv2\" (UniqueName: \"kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.311423 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.311363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:20.433270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:20.433248    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"]
Jul 20 19:04:20.435556 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:04:20.435532    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eab19fc_4d2a_43a7_a150_cf9763c8b2f3.slice/crio-14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4 WatchSource:0}: Error finding container 14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4: Status 404 returned error can't find the container with id 14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4
Jul 20 19:04:21.362076 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:21.362036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx" event={"ID":"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3","Type":"ContainerStarted","Data":"14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4"}
Jul 20 19:04:28.386958 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:28.386922    2563 generic.go:356] "Generic (PLEG): container finished" podID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerID="21cc8764af71a9859cf96c68c425a6b2d51baa44f1d637e95b813e2484e8ba0c" exitCode=0
Jul 20 19:04:28.387335 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:28.386975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx" event={"ID":"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3","Type":"ContainerDied","Data":"21cc8764af71a9859cf96c68c425a6b2d51baa44f1d637e95b813e2484e8ba0c"}
Jul 20 19:04:31.400299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:31.400267    2563 generic.go:356] "Generic (PLEG): container finished" podID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerID="67b016d6a287dee26f5cb40187cc8055473b0214d216690e5098cb4864a11632" exitCode=0
Jul 20 19:04:31.400681 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:31.400304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx" event={"ID":"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3","Type":"ContainerDied","Data":"67b016d6a287dee26f5cb40187cc8055473b0214d216690e5098cb4864a11632"}
Jul 20 19:04:41.441091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:41.441058    2563 generic.go:356] "Generic (PLEG): container finished" podID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerID="9963dd36945f5e71fa211a05d9780a74dd9b809c53db9e05e5bec5ce9261322a" exitCode=0
Jul 20 19:04:41.441460 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:41.441120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx" event={"ID":"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3","Type":"ContainerDied","Data":"9963dd36945f5e71fa211a05d9780a74dd9b809c53db9e05e5bec5ce9261322a"}
Jul 20 19:04:42.593615 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.593585    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:42.756002 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.755967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnwv2\" (UniqueName: \"kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2\") pod \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") "
Jul 20 19:04:42.756183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.756038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle\") pod \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") "
Jul 20 19:04:42.756183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.756114    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util\") pod \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\" (UID: \"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3\") "
Jul 20 19:04:42.756886 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.756856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle" (OuterVolumeSpecName: "bundle") pod "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" (UID: "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:42.758233 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.758193    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2" (OuterVolumeSpecName: "kube-api-access-xnwv2") pod "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" (UID: "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3"). InnerVolumeSpecName "kube-api-access-xnwv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:42.760671 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.760650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util" (OuterVolumeSpecName: "util") pod "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" (UID: "9eab19fc-4d2a-43a7-a150-cf9763c8b2f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:42.857252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.857220    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:42.857252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.857248    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnwv2\" (UniqueName: \"kubernetes.io/projected/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-kube-api-access-xnwv2\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:42.857252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:42.857258    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eab19fc-4d2a-43a7-a150-cf9763c8b2f3-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:43.450107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:43.450082    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx"
Jul 20 19:04:43.450107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:43.450091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540l48bx" event={"ID":"9eab19fc-4d2a-43a7-a150-cf9763c8b2f3","Type":"ContainerDied","Data":"14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4"}
Jul 20 19:04:43.450359 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:43.450134    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14579bf9307ba5ded83c338109457411d5f111056692291b6a080cadfd8644a4"
Jul 20 19:04:47.977454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"]
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977652    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="util"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977662    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="util"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977675    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="pull"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977680    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="pull"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977690    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="extract"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977695    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="extract"
Jul 20 19:04:47.977922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.977740    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eab19fc-4d2a-43a7-a150-cf9763c8b2f3" containerName="extract"
Jul 20 19:04:47.980884 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.980866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:47.983685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.983655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:04:47.983814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.983738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-74w5k\""
Jul 20 19:04:47.983814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.983786    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 19:04:47.989021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.989001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725a306a-9d9d-41d0-8826-372c65d1c55a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:47.989105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.989044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzr8b\" (UniqueName: \"kubernetes.io/projected/725a306a-9d9d-41d0-8826-372c65d1c55a-kube-api-access-dzr8b\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:47.997642 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:47.997623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"]
Jul 20 19:04:48.089506 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.089486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzr8b\" (UniqueName: \"kubernetes.io/projected/725a306a-9d9d-41d0-8826-372c65d1c55a-kube-api-access-dzr8b\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:48.089625 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.089558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725a306a-9d9d-41d0-8826-372c65d1c55a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:48.089923 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.089907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725a306a-9d9d-41d0-8826-372c65d1c55a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:48.098631 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.098611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzr8b\" (UniqueName: \"kubernetes.io/projected/725a306a-9d9d-41d0-8826-372c65d1c55a-kube-api-access-dzr8b\") pod \"cert-manager-operator-controller-manager-55c444bf86-frcbk\" (UID: \"725a306a-9d9d-41d0-8826-372c65d1c55a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:48.289389 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.289366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"
Jul 20 19:04:48.412827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.412808    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk"]
Jul 20 19:04:48.415750 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:04:48.415721    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725a306a_9d9d_41d0_8826_372c65d1c55a.slice/crio-aff9f91d2acc6b1801e967051b73eba33f33bae9ed906e88469105f11c41c91c WatchSource:0}: Error finding container aff9f91d2acc6b1801e967051b73eba33f33bae9ed906e88469105f11c41c91c: Status 404 returned error can't find the container with id aff9f91d2acc6b1801e967051b73eba33f33bae9ed906e88469105f11c41c91c
Jul 20 19:04:48.466424 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:48.466394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk" event={"ID":"725a306a-9d9d-41d0-8826-372c65d1c55a","Type":"ContainerStarted","Data":"aff9f91d2acc6b1801e967051b73eba33f33bae9ed906e88469105f11c41c91c"}
Jul 20 19:04:50.475336 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:50.475299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk" event={"ID":"725a306a-9d9d-41d0-8826-372c65d1c55a","Type":"ContainerStarted","Data":"d0037fe1d85065899226b7edac2f791da89ae8132f973349674a8f18a219d5d3"}
Jul 20 19:04:50.502101 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:50.502052    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frcbk" podStartSLOduration=2.074229849 podStartE2EDuration="3.502035524s" totalImagesPullingTime="1.427805675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:04:50.499694796 +0000 UTC m=+250.681218005" watchObservedRunningTime="2026-07-20 19:04:50.502035524 +0000 UTC m=+250.683558714"
Jul 20 19:04:51.675687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.675656    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"]
Jul 20 19:04:51.677835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.677820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.680776 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.680738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:04:51.680891 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.680779    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:04:51.681910 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.681890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mnq8k\""
Jul 20 19:04:51.688784 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.688750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"]
Jul 20 19:04:51.712562 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.712541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.712676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.712577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjc5\" (UniqueName: \"kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.712676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.712626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.813914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.813884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.814010 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.813920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.814010 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.813942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjc5\" (UniqueName: \"kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.814320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.814300    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.814356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.814316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.822829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.822799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjc5\" (UniqueName: \"kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:51.986244 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:51.986164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:52.111817 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:52.111645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"]
Jul 20 19:04:52.113721 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:04:52.113699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3567a90_a1b0_4c7b_b52f_7536871b4c7f.slice/crio-14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9 WatchSource:0}: Error finding container 14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9: Status 404 returned error can't find the container with id 14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9
Jul 20 19:04:52.483012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:52.482982    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerID="ac1191278e7d239a781b555c9204dbf6ebaa838df5c446643d62bb78c720a294" exitCode=0
Jul 20 19:04:52.483181 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:52.483037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerDied","Data":"ac1191278e7d239a781b555c9204dbf6ebaa838df5c446643d62bb78c720a294"}
Jul 20 19:04:52.483181 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:52.483070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerStarted","Data":"14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9"}
Jul 20 19:04:54.495107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:54.495066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerStarted","Data":"b69cbb28749c49e45d76b35b6acaa527c02d5edf57e55a80d178d07d01d9b9df"}
Jul 20 19:04:55.500607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:55.500568    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerID="b69cbb28749c49e45d76b35b6acaa527c02d5edf57e55a80d178d07d01d9b9df" exitCode=0
Jul 20 19:04:55.500981 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:55.500655    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerDied","Data":"b69cbb28749c49e45d76b35b6acaa527c02d5edf57e55a80d178d07d01d9b9df"}
Jul 20 19:04:56.506572 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:56.506543    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerID="1954c234e40bb45c6ef8b5e36b105a7592a8b13b00a85ad649a8b725e6ca53a4" exitCode=0
Jul 20 19:04:56.506948 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:56.506619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerDied","Data":"1954c234e40bb45c6ef8b5e36b105a7592a8b13b00a85ad649a8b725e6ca53a4"}
Jul 20 19:04:57.636342 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.636318    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:57.649688 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.649655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfjc5\" (UniqueName: \"kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5\") pod \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") "
Jul 20 19:04:57.649811 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.649736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util\") pod \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") "
Jul 20 19:04:57.649811 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.649803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle\") pod \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\" (UID: \"f3567a90-a1b0-4c7b-b52f-7536871b4c7f\") "
Jul 20 19:04:57.650132 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.650111    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle" (OuterVolumeSpecName: "bundle") pod "f3567a90-a1b0-4c7b-b52f-7536871b4c7f" (UID: "f3567a90-a1b0-4c7b-b52f-7536871b4c7f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:57.651723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.651694    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5" (OuterVolumeSpecName: "kube-api-access-vfjc5") pod "f3567a90-a1b0-4c7b-b52f-7536871b4c7f" (UID: "f3567a90-a1b0-4c7b-b52f-7536871b4c7f"). InnerVolumeSpecName "kube-api-access-vfjc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:57.669512 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.669473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util" (OuterVolumeSpecName: "util") pod "f3567a90-a1b0-4c7b-b52f-7536871b4c7f" (UID: "f3567a90-a1b0-4c7b-b52f-7536871b4c7f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:04:57.750620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.750587    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:57.750620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.750617    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfjc5\" (UniqueName: \"kubernetes.io/projected/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-kube-api-access-vfjc5\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:57.750620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:57.750628    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3567a90-a1b0-4c7b-b52f-7536871b4c7f-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:04:58.516178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:58.516151    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67"
Jul 20 19:04:58.516339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:58.516152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwnc67" event={"ID":"f3567a90-a1b0-4c7b-b52f-7536871b4c7f","Type":"ContainerDied","Data":"14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9"}
Jul 20 19:04:58.516339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:04:58.516268    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14fac16b801757534b5357033ff308051c03c194fa59869d1e46c1fd28dc7ea9"
Jul 20 19:05:04.384771 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.384675    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gfb"]
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.384986    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="extract"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.384999    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="extract"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.385010    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="util"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.385015    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="util"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.385022    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="pull"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.385027    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="pull"
Jul 20 19:05:04.385238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.385080    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3567a90-a1b0-4c7b-b52f-7536871b4c7f" containerName="extract"
Jul 20 19:05:04.386846 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.386829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.389679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.389659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 19:05:04.391029 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.391015    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cs449\""
Jul 20 19:05:04.391089 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.391023    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 19:05:04.391814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.391797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8z7z\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-kube-api-access-w8z7z\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.391876 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.391832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.400500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.400476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gfb"]
Jul 20 19:05:04.492352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.492315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8z7z\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-kube-api-access-w8z7z\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.492352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.492357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.501403 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.501374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.501668 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.501648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8z7z\" (UniqueName: \"kubernetes.io/projected/f27a01ba-5608-4556-b668-15c37ff4d3ae-kube-api-access-w8z7z\") pod \"cert-manager-55b4d954d5-b7gfb\" (UID: \"f27a01ba-5608-4556-b668-15c37ff4d3ae\") " pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.696244 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.696152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-b7gfb"
Jul 20 19:05:04.820497 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.820464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-b7gfb"]
Jul 20 19:05:04.823447 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:04.823421    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf27a01ba_5608_4556_b668_15c37ff4d3ae.slice/crio-a88fd86f243a490a5ec3dea7b8d538776fe5c4f111eb2da477446c5de1f8e7c6 WatchSource:0}: Error finding container a88fd86f243a490a5ec3dea7b8d538776fe5c4f111eb2da477446c5de1f8e7c6: Status 404 returned error can't find the container with id a88fd86f243a490a5ec3dea7b8d538776fe5c4f111eb2da477446c5de1f8e7c6
Jul 20 19:05:04.884517 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.884483    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"]
Jul 20 19:05:04.886931 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.886915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:04.889660 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.889636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:05:04.889826 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.889808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 19:05:04.889879 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.889837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sl5nw\""
Jul 20 19:05:04.896002 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.895977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a112a68-b433-4a96-8c44-d5095bd177b7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:04.896147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.896014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5nbr\" (UniqueName: \"kubernetes.io/projected/9a112a68-b433-4a96-8c44-d5095bd177b7-kube-api-access-p5nbr\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:04.896727 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.896708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"]
Jul 20 19:05:04.997203 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.997172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a112a68-b433-4a96-8c44-d5095bd177b7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:04.997376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.997211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5nbr\" (UniqueName: \"kubernetes.io/projected/9a112a68-b433-4a96-8c44-d5095bd177b7-kube-api-access-p5nbr\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:04.997557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:04.997536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a112a68-b433-4a96-8c44-d5095bd177b7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:05.006108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:05.006078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5nbr\" (UniqueName: \"kubernetes.io/projected/9a112a68-b433-4a96-8c44-d5095bd177b7-kube-api-access-p5nbr\") pod \"openshift-lws-operator-fd8ccff4c-gl8gz\" (UID: \"9a112a68-b433-4a96-8c44-d5095bd177b7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:05.196243 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:05.196210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"
Jul 20 19:05:05.323657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:05.323626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz"]
Jul 20 19:05:05.326509 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:05.326477    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a112a68_b433_4a96_8c44_d5095bd177b7.slice/crio-a59247a440a1db758c88d2d8be3f8faf7c7851b5165544f2ef53990304c5cbd0 WatchSource:0}: Error finding container a59247a440a1db758c88d2d8be3f8faf7c7851b5165544f2ef53990304c5cbd0: Status 404 returned error can't find the container with id a59247a440a1db758c88d2d8be3f8faf7c7851b5165544f2ef53990304c5cbd0
Jul 20 19:05:05.544905 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:05.544818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz" event={"ID":"9a112a68-b433-4a96-8c44-d5095bd177b7","Type":"ContainerStarted","Data":"a59247a440a1db758c88d2d8be3f8faf7c7851b5165544f2ef53990304c5cbd0"}
Jul 20 19:05:05.546119 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:05.546085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b7gfb" event={"ID":"f27a01ba-5608-4556-b668-15c37ff4d3ae","Type":"ContainerStarted","Data":"a88fd86f243a490a5ec3dea7b8d538776fe5c4f111eb2da477446c5de1f8e7c6"}
Jul 20 19:05:09.566850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:09.566810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz" event={"ID":"9a112a68-b433-4a96-8c44-d5095bd177b7","Type":"ContainerStarted","Data":"6b288e0f356d6efab67044da4548571d2ced77b2071f6760843b4c200cd058c8"}
Jul 20 19:05:09.568354 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:09.568326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-b7gfb" event={"ID":"f27a01ba-5608-4556-b668-15c37ff4d3ae","Type":"ContainerStarted","Data":"db1df361c5752d831919835173634731b198a1ad5f2fe20a212aa23660d6992f"}
Jul 20 19:05:09.583685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:09.583637    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gl8gz" podStartSLOduration=2.373819485 podStartE2EDuration="5.583619993s" totalImagesPullingTime="3.209800508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:09.583254267 +0000 UTC m=+269.764777457" watchObservedRunningTime="2026-07-20 19:05:09.583619993 +0000 UTC m=+269.765143184"
Jul 20 19:05:09.603136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:09.603099    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-b7gfb" podStartSLOduration=1.896400099 podStartE2EDuration="5.603087982s" totalImagesPullingTime="3.706687883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:09.6024779 +0000 UTC m=+269.784001091" watchObservedRunningTime="2026-07-20 19:05:09.603087982 +0000 UTC m=+269.784611172"
Jul 20 19:05:13.719426 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.719387    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"]
Jul 20 19:05:13.721694 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.721671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.724584 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.724566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 19:05:13.726019 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.725993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 19:05:13.726108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.726045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mnq8k\""
Jul 20 19:05:13.733210 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.733179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"]
Jul 20 19:05:13.762967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.762922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.762967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.762963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.763177 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.763022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpjh\" (UniqueName: \"kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.864091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.864055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpjh\" (UniqueName: \"kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.864091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.864106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.864353 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.864125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.864472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.864454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.864536 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.864514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:13.872540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:13.872514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpjh\" (UniqueName: \"kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:14.031704 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:14.031671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:14.156435 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:14.156410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"]
Jul 20 19:05:14.158990 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:14.158953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592c002c_9c0c_4025_8999_fb987d7c5c9b.slice/crio-db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303 WatchSource:0}: Error finding container db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303: Status 404 returned error can't find the container with id db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303
Jul 20 19:05:14.589039 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:14.589007    2563 generic.go:356] "Generic (PLEG): container finished" podID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerID="c89e7f9b60cb99cdf5f2a6675bf597e1bc23a14ff682200e43e9ac186349448a" exitCode=0
Jul 20 19:05:14.589215 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:14.589069    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5" event={"ID":"592c002c-9c0c-4025-8999-fb987d7c5c9b","Type":"ContainerDied","Data":"c89e7f9b60cb99cdf5f2a6675bf597e1bc23a14ff682200e43e9ac186349448a"}
Jul 20 19:05:14.589215 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:14.589106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5" event={"ID":"592c002c-9c0c-4025-8999-fb987d7c5c9b","Type":"ContainerStarted","Data":"db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303"}
Jul 20 19:05:15.595113 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:15.595025    2563 generic.go:356] "Generic (PLEG): container finished" podID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerID="8a056d6d4a61980208248cc0e1c64182add8cfb80f0696e5a0f141d6420a6ea0" exitCode=0
Jul 20 19:05:15.595489 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:15.595116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5" event={"ID":"592c002c-9c0c-4025-8999-fb987d7c5c9b","Type":"ContainerDied","Data":"8a056d6d4a61980208248cc0e1c64182add8cfb80f0696e5a0f141d6420a6ea0"}
Jul 20 19:05:16.600910 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:16.600874    2563 generic.go:356] "Generic (PLEG): container finished" podID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerID="91bec105c20553c87cb5cdfef38d027ebf244a65cfd5aba0d03c7fc2b2d65808" exitCode=0
Jul 20 19:05:16.601283 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:16.600916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5" event={"ID":"592c002c-9c0c-4025-8999-fb987d7c5c9b","Type":"ContainerDied","Data":"91bec105c20553c87cb5cdfef38d027ebf244a65cfd5aba0d03c7fc2b2d65808"}
Jul 20 19:05:17.743938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.743911    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:17.792145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.792116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle\") pod \"592c002c-9c0c-4025-8999-fb987d7c5c9b\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") "
Jul 20 19:05:17.792263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.792158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gpjh\" (UniqueName: \"kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh\") pod \"592c002c-9c0c-4025-8999-fb987d7c5c9b\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") "
Jul 20 19:05:17.792263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.792206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util\") pod \"592c002c-9c0c-4025-8999-fb987d7c5c9b\" (UID: \"592c002c-9c0c-4025-8999-fb987d7c5c9b\") "
Jul 20 19:05:17.792871 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.792842    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle" (OuterVolumeSpecName: "bundle") pod "592c002c-9c0c-4025-8999-fb987d7c5c9b" (UID: "592c002c-9c0c-4025-8999-fb987d7c5c9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:05:17.794274 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.794246    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh" (OuterVolumeSpecName: "kube-api-access-7gpjh") pod "592c002c-9c0c-4025-8999-fb987d7c5c9b" (UID: "592c002c-9c0c-4025-8999-fb987d7c5c9b"). InnerVolumeSpecName "kube-api-access-7gpjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:05:17.798046 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.798024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util" (OuterVolumeSpecName: "util") pod "592c002c-9c0c-4025-8999-fb987d7c5c9b" (UID: "592c002c-9c0c-4025-8999-fb987d7c5c9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:05:17.892724 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.892673    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:05:17.892724 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.892693    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/592c002c-9c0c-4025-8999-fb987d7c5c9b-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:05:17.892724 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:17.892702    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpjh\" (UniqueName: \"kubernetes.io/projected/592c002c-9c0c-4025-8999-fb987d7c5c9b-kube-api-access-7gpjh\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:05:18.610801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:18.610743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5" event={"ID":"592c002c-9c0c-4025-8999-fb987d7c5c9b","Type":"ContainerDied","Data":"db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303"}
Jul 20 19:05:18.610965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:18.610825    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db8da16a72cd104609ca57805162b52db081c107b1f1f9b20571e71e49c12303"
Jul 20 19:05:18.610965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:18.610784    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9wfb5"
Jul 20 19:05:25.431377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431344    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"]
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431618    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="util"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431631    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="util"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431648    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="extract"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431654    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="extract"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431662    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="pull"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431669    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="pull"
Jul 20 19:05:25.431793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.431729    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="592c002c-9c0c-4025-8999-fb987d7c5c9b" containerName="extract"
Jul 20 19:05:25.434248 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.434229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.437082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.437056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 19:05:25.437425 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.437396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 19:05:25.437425 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.437411    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wsgrw\""
Jul 20 19:05:25.437636 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.437579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 19:05:25.440519 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.440497    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 19:05:25.454148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.454127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"]
Jul 20 19:05:25.543132 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.543105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.543240 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.543134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.543240 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.543171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.543240 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.543203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqgqf\" (UniqueName: \"kubernetes.io/projected/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-kube-api-access-xqgqf\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.543240 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.543227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644099 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqgqf\" (UniqueName: \"kubernetes.io/projected/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-kube-api-access-xqgqf\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.644460 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.644441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.646390 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.646358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.646638 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.646619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.646698 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.646619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.653079 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.653057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqgqf\" (UniqueName: \"kubernetes.io/projected/dc53a6f7-92fd-47be-ae45-594e3c3b6a0b-kube-api-access-xqgqf\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-d9nqq\" (UID: \"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.744804 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.744775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:25.882315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:25.882283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"]
Jul 20 19:05:25.885815 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:25.885739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc53a6f7_92fd_47be_ae45_594e3c3b6a0b.slice/crio-6699ae5ba515a9674575a77766fd6fdd52f92c61c2c5db444bfef5ef6d997bf5 WatchSource:0}: Error finding container 6699ae5ba515a9674575a77766fd6fdd52f92c61c2c5db444bfef5ef6d997bf5: Status 404 returned error can't find the container with id 6699ae5ba515a9674575a77766fd6fdd52f92c61c2c5db444bfef5ef6d997bf5
Jul 20 19:05:26.645656 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:26.645620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq" event={"ID":"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b","Type":"ContainerStarted","Data":"6699ae5ba515a9674575a77766fd6fdd52f92c61c2c5db444bfef5ef6d997bf5"}
Jul 20 19:05:29.662340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:29.662304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq" event={"ID":"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b","Type":"ContainerStarted","Data":"93ec08ea11f57bccd98a8104bd9372b7582977eeb1ab8f574fe23c3fcf62cf00"}
Jul 20 19:05:30.668100 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:30.668017    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc53a6f7-92fd-47be-ae45-594e3c3b6a0b" containerID="93ec08ea11f57bccd98a8104bd9372b7582977eeb1ab8f574fe23c3fcf62cf00" exitCode=0
Jul 20 19:05:30.668100 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:30.668065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq" event={"ID":"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b","Type":"ContainerDied","Data":"93ec08ea11f57bccd98a8104bd9372b7582977eeb1ab8f574fe23c3fcf62cf00"}
Jul 20 19:05:31.674632 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:31.674598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq" event={"ID":"dc53a6f7-92fd-47be-ae45-594e3c3b6a0b","Type":"ContainerStarted","Data":"cdc0577439bd9fea466d797f2f13ca34baa787fb6f4ae4a48e8926120f02fefb"}
Jul 20 19:05:31.675147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:31.674725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:31.698408 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:31.698362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq" podStartSLOduration=2.066273516 podStartE2EDuration="6.698344436s" totalImagesPullingTime="3.609854508s" totalInitContainerRuntime="1.022216412s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:31.696550123 +0000 UTC m=+291.878073326" watchObservedRunningTime="2026-07-20 19:05:31.698344436 +0000 UTC m=+291.879867629"
Jul 20 19:05:40.244096 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:40.244067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:05:40.247157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:40.247128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:05:40.248082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:40.248065    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 19:05:42.681529 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:42.681497    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-d9nqq"
Jul 20 19:05:45.798898 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.798862    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"]
Jul 20 19:05:45.801341 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.801316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.807540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.807507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c4h44\""
Jul 20 19:05:45.807705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.807645    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:05:45.808569 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.808544    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 19:05:45.808887 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.808866    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 19:05:45.812067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.812046    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:05:45.833899 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.833872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"]
Jul 20 19:05:45.875281 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.875260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.875369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.875314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6a779f7-0628-4107-9903-a2483691c07b-tmp\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.875369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.875341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwkqf\" (UniqueName: \"kubernetes.io/projected/a6a779f7-0628-4107-9903-a2483691c07b-kube-api-access-vwkqf\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.976480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.976451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6a779f7-0628-4107-9903-a2483691c07b-tmp\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.976666 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.976486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwkqf\" (UniqueName: \"kubernetes.io/projected/a6a779f7-0628-4107-9903-a2483691c07b-kube-api-access-vwkqf\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.976666 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.976527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.976666 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:45.976660    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 19:05:45.976866 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:45.976731    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs podName:a6a779f7-0628-4107-9903-a2483691c07b nodeName:}" failed. No retries permitted until 2026-07-20 19:05:46.476708768 +0000 UTC m=+306.658231935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs") pod "kube-auth-proxy-566bb86f76-zzv96" (UID: "a6a779f7-0628-4107-9903-a2483691c07b") : secret "kube-auth-proxy-tls" not found
Jul 20 19:05:45.979136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.979098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6a779f7-0628-4107-9903-a2483691c07b-tmp\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:45.992435 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:45.992413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwkqf\" (UniqueName: \"kubernetes.io/projected/a6a779f7-0628-4107-9903-a2483691c07b-kube-api-access-vwkqf\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:46.130596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.130521    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4p8rq"]
Jul 20 19:05:46.132739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.132723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.136305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.136287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bgbdx\""
Jul 20 19:05:46.138348 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.138321    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 19:05:46.158037 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.158014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4p8rq"]
Jul 20 19:05:46.178279 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.178256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.178398 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.178318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m785v\" (UniqueName: \"kubernetes.io/projected/c08ef001-a82d-4282-8068-950cdd25c4d7-kube-api-access-m785v\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.278742 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.278698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.278924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.278803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m785v\" (UniqueName: \"kubernetes.io/projected/c08ef001-a82d-4282-8068-950cdd25c4d7-kube-api-access-m785v\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.278924 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:46.278877    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 19:05:46.279040 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:46.278951    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert podName:c08ef001-a82d-4282-8068-950cdd25c4d7 nodeName:}" failed. No retries permitted until 2026-07-20 19:05:46.778929883 +0000 UTC m=+306.960453054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert") pod "odh-model-controller-7998c67dc4-4p8rq" (UID: "c08ef001-a82d-4282-8068-950cdd25c4d7") : secret "odh-model-controller-webhook-cert" not found
Jul 20 19:05:46.293354 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.293318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m785v\" (UniqueName: \"kubernetes.io/projected/c08ef001-a82d-4282-8068-950cdd25c4d7-kube-api-access-m785v\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.480209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.480115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:46.482820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.482794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a779f7-0628-4107-9903-a2483691c07b-tls-certs\") pod \"kube-auth-proxy-566bb86f76-zzv96\" (UID: \"a6a779f7-0628-4107-9903-a2483691c07b\") " pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:46.711829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.711792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"
Jul 20 19:05:46.781633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.781536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.784038 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.784010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08ef001-a82d-4282-8068-950cdd25c4d7-cert\") pod \"odh-model-controller-7998c67dc4-4p8rq\" (UID: \"c08ef001-a82d-4282-8068-950cdd25c4d7\") " pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:46.854647 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.854623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bb86f76-zzv96"]
Jul 20 19:05:46.856132 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:46.856104    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a779f7_0628_4107_9903_a2483691c07b.slice/crio-2ebd71a1fe0453fb03ae70dd4d343fe37bf7a238579402b1526da9b985924619 WatchSource:0}: Error finding container 2ebd71a1fe0453fb03ae70dd4d343fe37bf7a238579402b1526da9b985924619: Status 404 returned error can't find the container with id 2ebd71a1fe0453fb03ae70dd4d343fe37bf7a238579402b1526da9b985924619
Jul 20 19:05:46.858046 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:46.858027    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:05:47.043461 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.043389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:47.214423 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.214302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4p8rq"]
Jul 20 19:05:47.217526 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:47.217494    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08ef001_a82d_4282_8068_950cdd25c4d7.slice/crio-4c9f5d8f1ed0cc454101c7db72dda5fef707aab23dca4c5ad4584b8925f3a4f8 WatchSource:0}: Error finding container 4c9f5d8f1ed0cc454101c7db72dda5fef707aab23dca4c5ad4584b8925f3a4f8: Status 404 returned error can't find the container with id 4c9f5d8f1ed0cc454101c7db72dda5fef707aab23dca4c5ad4584b8925f3a4f8
Jul 20 19:05:47.397906 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.397830    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-58p4w"]
Jul 20 19:05:47.400924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.400902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.403816 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.403795    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-89sjs\""
Jul 20 19:05:47.404082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.404065    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 19:05:47.415392 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.415276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-58p4w"]
Jul 20 19:05:47.487954 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.487924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmgn\" (UniqueName: \"kubernetes.io/projected/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-kube-api-access-llmgn\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.488126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.488041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.588488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.588456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.588488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.588494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmgn\" (UniqueName: \"kubernetes.io/projected/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-kube-api-access-llmgn\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.588739 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:47.588646    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 20 19:05:47.588739 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:47.588723    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs podName:cb5c8a6e-7ad9-4755-8797-d31de46d3e70 nodeName:}" failed. No retries permitted until 2026-07-20 19:05:48.088702559 +0000 UTC m=+308.270225732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs") pod "model-serving-api-54d89bd5fc-58p4w" (UID: "cb5c8a6e-7ad9-4755-8797-d31de46d3e70") : secret "model-serving-api-tls" not found
Jul 20 19:05:47.605235 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.605208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmgn\" (UniqueName: \"kubernetes.io/projected/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-kube-api-access-llmgn\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:47.608225 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.608194    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:05:47.610474 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.610452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.613971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.613952    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 19:05:47.614075 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.613976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 19:05:47.614252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.614233    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 19:05:47.614436 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.614423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 19:05:47.614563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.614549    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g2d5q\""
Jul 20 19:05:47.628213 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.628194    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:05:47.689885 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.689990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pw6n\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.690034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.690015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.753074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.753031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96" event={"ID":"a6a779f7-0628-4107-9903-a2483691c07b","Type":"ContainerStarted","Data":"2ebd71a1fe0453fb03ae70dd4d343fe37bf7a238579402b1526da9b985924619"}
Jul 20 19:05:47.754319 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.754291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq" event={"ID":"c08ef001-a82d-4282-8068-950cdd25c4d7","Type":"ContainerStarted","Data":"4c9f5d8f1ed0cc454101c7db72dda5fef707aab23dca4c5ad4584b8925f3a4f8"}
Jul 20 19:05:47.790767 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.790713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.790917 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.790808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.790988 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.790965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.791103 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.790999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.791103 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.791016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.791103 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.791041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pw6n\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.791103 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.791071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.791672 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.791622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.793339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.793318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.793815 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.793796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.793904 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.793826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.793904 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.793844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.798723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.798703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pw6n\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.798845 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.798722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token\") pod \"istiod-openshift-gateway-7574459656-cbsvf\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:47.920770 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:47.920723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:05:48.074178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.074138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:05:48.076645 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:48.076613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0305a7b5_a638_405a_ad5b_244012c6386f.slice/crio-fe8abec72019486024024f867209398d73de0a7a4dfdd93b448ea28987aceb23 WatchSource:0}: Error finding container fe8abec72019486024024f867209398d73de0a7a4dfdd93b448ea28987aceb23: Status 404 returned error can't find the container with id fe8abec72019486024024f867209398d73de0a7a4dfdd93b448ea28987aceb23
Jul 20 19:05:48.094096 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.094026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:48.097072 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.097046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb5c8a6e-7ad9-4755-8797-d31de46d3e70-tls-certs\") pod \"model-serving-api-54d89bd5fc-58p4w\" (UID: \"cb5c8a6e-7ad9-4755-8797-d31de46d3e70\") " pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:48.316747 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.316709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:48.458498 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.458447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-58p4w"]
Jul 20 19:05:48.460854 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:48.460828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5c8a6e_7ad9_4755_8797_d31de46d3e70.slice/crio-97ddb5f7be2ed19068af76f9cdcba8add4d7923cefe879ac96216e2bc8be8226 WatchSource:0}: Error finding container 97ddb5f7be2ed19068af76f9cdcba8add4d7923cefe879ac96216e2bc8be8226: Status 404 returned error can't find the container with id 97ddb5f7be2ed19068af76f9cdcba8add4d7923cefe879ac96216e2bc8be8226
Jul 20 19:05:48.761830 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.761788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w" event={"ID":"cb5c8a6e-7ad9-4755-8797-d31de46d3e70","Type":"ContainerStarted","Data":"97ddb5f7be2ed19068af76f9cdcba8add4d7923cefe879ac96216e2bc8be8226"}
Jul 20 19:05:48.763149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:48.763120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" event={"ID":"0305a7b5-a638-405a-ad5b-244012c6386f","Type":"ContainerStarted","Data":"fe8abec72019486024024f867209398d73de0a7a4dfdd93b448ea28987aceb23"}
Jul 20 19:05:50.779643 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:50.779532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq" event={"ID":"c08ef001-a82d-4282-8068-950cdd25c4d7","Type":"ContainerStarted","Data":"8846050d6a0b9b3e5cda27e9d05c4890bae1cd767f30ad7cb24468cf08a94bea"}
Jul 20 19:05:50.780117 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:50.779806    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:05:50.797106 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:50.797045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq" podStartSLOduration=1.8830361340000001 podStartE2EDuration="4.797025523s" totalImagesPullingTime="2.913989389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:50.795882501 +0000 UTC m=+310.977405703" watchObservedRunningTime="2026-07-20 19:05:50.797025523 +0000 UTC m=+310.978548734"
Jul 20 19:05:52.790837 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:52.790796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w" event={"ID":"cb5c8a6e-7ad9-4755-8797-d31de46d3e70","Type":"ContainerStarted","Data":"619c9f419090eac4700005fbdead07af953a9d85def5158f89c586cff5e32305"}
Jul 20 19:05:52.791296 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:52.791029    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:05:52.792512 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:52.792478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96" event={"ID":"a6a779f7-0628-4107-9903-a2483691c07b","Type":"ContainerStarted","Data":"6264719e5532b351d08001a5c61ce0e1317114dc397bb573cd45ff1c8365d866"}
Jul 20 19:05:52.808705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:52.808657    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w" podStartSLOduration=2.106339833 podStartE2EDuration="5.808642802s" totalImagesPullingTime="3.702302969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:52.807189844 +0000 UTC m=+312.988713034" watchObservedRunningTime="2026-07-20 19:05:52.808642802 +0000 UTC m=+312.990165992"
Jul 20 19:05:52.823452 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:52.823415    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-566bb86f76-zzv96" podStartSLOduration=2.510620345 podStartE2EDuration="7.82340262s" totalImagesPullingTime="5.312782275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:52.82278059 +0000 UTC m=+313.004303783" watchObservedRunningTime="2026-07-20 19:05:52.82340262 +0000 UTC m=+313.004925809"
Jul 20 19:05:57.149488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.149451    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"]
Jul 20 19:05:57.152746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.152728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.155874 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.155846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 19:05:57.156533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.156514    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"]
Jul 20 19:05:57.156688 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.156671    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tbhk6\""
Jul 20 19:05:57.159650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.159630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.162414 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.162385    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lld66\""
Jul 20 19:05:57.162703 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.162689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 19:05:57.163338 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.163316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"]
Jul 20 19:05:57.170568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.170543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"]
Jul 20 19:05:57.269441 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.269411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bcd4b8-0749-40e1-9d0b-f9fb064da415-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.269573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.269463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r75wk\" (UniqueName: \"kubernetes.io/projected/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-kube-api-access-r75wk\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.269573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.269514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.269573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.269556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbzff\" (UniqueName: \"kubernetes.io/projected/53bcd4b8-0749-40e1-9d0b-f9fb064da415-kube-api-access-tbzff\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.370638 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.370612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bcd4b8-0749-40e1-9d0b-f9fb064da415-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.370792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.370656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r75wk\" (UniqueName: \"kubernetes.io/projected/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-kube-api-access-r75wk\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.370792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.370683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.370792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.370731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbzff\" (UniqueName: \"kubernetes.io/projected/53bcd4b8-0749-40e1-9d0b-f9fb064da415-kube-api-access-tbzff\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.370961 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:57.370892    2563 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 20 19:05:57.371019 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:05:57.370983    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert podName:d42812ee-7b77-49d5-a3d0-dfcdb41fe790 nodeName:}" failed. No retries permitted until 2026-07-20 19:05:57.870960724 +0000 UTC m=+318.052483895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert") pod "llmisvc-controller-manager-777c6bd7d5-5lrvq" (UID: "d42812ee-7b77-49d5-a3d0-dfcdb41fe790") : secret "llmisvc-webhook-server-cert" not found
Jul 20 19:05:57.373453 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.373428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53bcd4b8-0749-40e1-9d0b-f9fb064da415-cert\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.391148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.391125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r75wk\" (UniqueName: \"kubernetes.io/projected/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-kube-api-access-r75wk\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.391440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.391418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbzff\" (UniqueName: \"kubernetes.io/projected/53bcd4b8-0749-40e1-9d0b-f9fb064da415-kube-api-access-tbzff\") pod \"kserve-controller-manager-d6f4b65b8-v8flf\" (UID: \"53bcd4b8-0749-40e1-9d0b-f9fb064da415\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.466093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.466009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:05:57.606402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.606373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"]
Jul 20 19:05:57.607544 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:57.607512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bcd4b8_0749_40e1_9d0b_f9fb064da415.slice/crio-743d3f6a78ba31c0cb3916ebe289b0e3213ad70aa56f449e18941503ea15a1e4 WatchSource:0}: Error finding container 743d3f6a78ba31c0cb3916ebe289b0e3213ad70aa56f449e18941503ea15a1e4: Status 404 returned error can't find the container with id 743d3f6a78ba31c0cb3916ebe289b0e3213ad70aa56f449e18941503ea15a1e4
Jul 20 19:05:57.813881 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.813854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf" event={"ID":"53bcd4b8-0749-40e1-9d0b-f9fb064da415","Type":"ContainerStarted","Data":"743d3f6a78ba31c0cb3916ebe289b0e3213ad70aa56f449e18941503ea15a1e4"}
Jul 20 19:05:57.875372 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.875345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:57.877592 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:57.877564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d42812ee-7b77-49d5-a3d0-dfcdb41fe790-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5lrvq\" (UID: \"d42812ee-7b77-49d5-a3d0-dfcdb41fe790\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:58.074171 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:58.074120    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:05:58.201291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:58.201229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"]
Jul 20 19:05:58.203315 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:05:58.203288    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd42812ee_7b77_49d5_a3d0_dfcdb41fe790.slice/crio-838fb89093c8b48107d0d4a53df76e42acadc54c64f44d682d6df0a7acdcbf33 WatchSource:0}: Error finding container 838fb89093c8b48107d0d4a53df76e42acadc54c64f44d682d6df0a7acdcbf33: Status 404 returned error can't find the container with id 838fb89093c8b48107d0d4a53df76e42acadc54c64f44d682d6df0a7acdcbf33
Jul 20 19:05:58.820771 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:05:58.820718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq" event={"ID":"d42812ee-7b77-49d5-a3d0-dfcdb41fe790","Type":"ContainerStarted","Data":"838fb89093c8b48107d0d4a53df76e42acadc54c64f44d682d6df0a7acdcbf33"}
Jul 20 19:06:01.704475 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.704439    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:01.707056 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.707035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.710810 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.710177    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dlh42\""
Jul 20 19:06:01.721102 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.721079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:01.787253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.787224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4p8rq"
Jul 20 19:06:01.811529 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811649 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811649 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811786 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811786 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dsk\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811966 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.811966 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.811947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.832066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.832040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"]
Jul 20 19:06:01.834775 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.834739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.840147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.840109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf" event={"ID":"53bcd4b8-0749-40e1-9d0b-f9fb064da415","Type":"ContainerStarted","Data":"e98f3f2128c78ce5d8732aed4ef09b2ab2fb0587e076c4000e34c87cf95b522a"}
Jul 20 19:06:01.840265 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.840235    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:06:01.857026 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.856994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"]
Jul 20 19:06:01.912404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.912585 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.912730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.912812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.912812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.912921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.912921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913015 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913015 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.912976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbq9q\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-kube-api-access-vbq9q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913107 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913026    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf" podStartSLOduration=1.699863406 podStartE2EDuration="4.913008382s" totalImagesPullingTime="3.213144976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:01.911079388 +0000 UTC m=+322.092602578" watchObservedRunningTime="2026-07-20 19:06:01.913008382 +0000 UTC m=+322.094531570"
Jul 20 19:06:01.913380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dsk\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:01.913551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.913921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.913900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.914277 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.914253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.914391 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.914318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.914391 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.914382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.915605 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.915581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.916614 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.916579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.930636 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.930617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:01.932044 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:01.932025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dsk\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-r27v7\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:02.014173 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.014327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.014327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbq9q\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-kube-api-access-vbq9q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.014327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.014327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.014976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.015215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.015405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.015367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.017603 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.017570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.017914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.017884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.020588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.020569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:02.027147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.027125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.027460 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.027436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbq9q\" (UniqueName: \"kubernetes.io/projected/849fdb7c-4857-4e13-84ec-e76b7c7c2148-kube-api-access-vbq9q\") pod \"data-science-gateway-data-science-gateway-class-6576859cf445pz6\" (UID: \"849fdb7c-4857-4e13-84ec-e76b7c7c2148\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.148770 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.148719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:02.455642 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.455547    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:06:02.464036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.464013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"]
Jul 20 19:06:02.465275 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:06:02.465247    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849fdb7c_4857_4e13_84ec_e76b7c7c2148.slice/crio-d396f09284a51110276fb39970324c25e707c0aab8147ca63cb9513552b5070e WatchSource:0}: Error finding container d396f09284a51110276fb39970324c25e707c0aab8147ca63cb9513552b5070e: Status 404 returned error can't find the container with id d396f09284a51110276fb39970324c25e707c0aab8147ca63cb9513552b5070e
Jul 20 19:06:02.486493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.486470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:02.487481 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:06:02.487454    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a43bb5_d48f_4381_835f_5f4173d94c2e.slice/crio-d451f735ebeb445a89bdc5d419aee4168a2d59f2fa4abda2d0afe4d20f3f5177 WatchSource:0}: Error finding container d451f735ebeb445a89bdc5d419aee4168a2d59f2fa4abda2d0afe4d20f3f5177: Status 404 returned error can't find the container with id d451f735ebeb445a89bdc5d419aee4168a2d59f2fa4abda2d0afe4d20f3f5177
Jul 20 19:06:02.845243 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.845209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" event={"ID":"00a43bb5-d48f-4381-835f-5f4173d94c2e","Type":"ContainerStarted","Data":"d451f735ebeb445a89bdc5d419aee4168a2d59f2fa4abda2d0afe4d20f3f5177"}
Jul 20 19:06:02.846358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.846335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6" event={"ID":"849fdb7c-4857-4e13-84ec-e76b7c7c2148","Type":"ContainerStarted","Data":"d396f09284a51110276fb39970324c25e707c0aab8147ca63cb9513552b5070e"}
Jul 20 19:06:02.848035 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.848004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq" event={"ID":"d42812ee-7b77-49d5-a3d0-dfcdb41fe790","Type":"ContainerStarted","Data":"717af24d09f8110f25c73e3380078c90683a46d059c71b1c7e34f6e79b8b78af"}
Jul 20 19:06:02.868259 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:02.868214    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq" podStartSLOduration=1.779258992 podStartE2EDuration="5.868200009s" totalImagesPullingTime="4.088941017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:02.866520043 +0000 UTC m=+323.048043231" watchObservedRunningTime="2026-07-20 19:06:02.868200009 +0000 UTC m=+323.049723196"
Jul 20 19:06:03.801776 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:03.801727    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-58p4w"
Jul 20 19:06:03.859356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:03.859239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:06:06.383792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.383727    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.384158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.383824    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.384158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.383738    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.384158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.383906    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.384158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.383949    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.391928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.391905    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.392021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.391959    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.392021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.391994    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:06:06.878445 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.878399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" event={"ID":"00a43bb5-d48f-4381-835f-5f4173d94c2e","Type":"ContainerStarted","Data":"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"}
Jul 20 19:06:06.880437 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.880405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6" event={"ID":"849fdb7c-4857-4e13-84ec-e76b7c7c2148","Type":"ContainerStarted","Data":"51d60f5f6a91269b4f88c5053ffaee93c12f2dcf231a90185ff18cb594470819"}
Jul 20 19:06:06.882433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.882408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" event={"ID":"0305a7b5-a638-405a-ad5b-244012c6386f","Type":"ContainerStarted","Data":"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"}
Jul 20 19:06:06.882638 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.882618    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:06:06.882638 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.882456    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" podUID="0305a7b5-a638-405a-ad5b-244012c6386f" containerName="discovery" containerID="cri-o://22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f" gracePeriod=30
Jul 20 19:06:06.900043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.900000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" podStartSLOduration=1.9978327120000001 podStartE2EDuration="5.899984946s" totalImagesPullingTime="3.902152234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:06.898010833 +0000 UTC m=+327.079534047" watchObservedRunningTime="2026-07-20 19:06:06.899984946 +0000 UTC m=+327.081508136"
Jul 20 19:06:06.916428 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.916393    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" podStartSLOduration=1.612369653 podStartE2EDuration="19.916379239s" totalImagesPullingTime="18.304009586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:06.915523266 +0000 UTC m=+327.097046456" watchObservedRunningTime="2026-07-20 19:06:06.916379239 +0000 UTC m=+327.097902429"
Jul 20 19:06:06.937965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:06.937924    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6" podStartSLOduration=2.022069098 podStartE2EDuration="5.937913s" totalImagesPullingTime="3.915843902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:06.937231915 +0000 UTC m=+327.118755105" watchObservedRunningTime="2026-07-20 19:06:06.937913 +0000 UTC m=+327.119436189"
Jul 20 19:06:07.021267 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.021203    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:07.022374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.022351    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 20 19:06:07.022430 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.022402    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 20 19:06:07.131635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.131580    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:06:07.149878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.149804    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:07.155923 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.155721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:07.260157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260181    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pw6n\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260451 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260278    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260451 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260328    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert\") pod \"0305a7b5-a638-405a-ad5b-244012c6386f\" (UID: \"0305a7b5-a638-405a-ad5b-244012c6386f\") "
Jul 20 19:06:07.260648 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.260614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:06:07.262697 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262667    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:06:07.262818 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262712    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:06:07.262880 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262824    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n" (OuterVolumeSpecName: "kube-api-access-4pw6n") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "kube-api-access-4pw6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:06:07.262934 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:06:07.262983 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262947    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs" (OuterVolumeSpecName: "local-certs") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:07.262983 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.262952    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts" (OuterVolumeSpecName: "cacerts") pod "0305a7b5-a638-405a-ad5b-244012c6386f" (UID: "0305a7b5-a638-405a-ad5b-244012c6386f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:06:07.361068 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361052    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-dns-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361068 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361070    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361080    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0305a7b5-a638-405a-ad5b-244012c6386f-istio-csr-ca-configmap\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361089    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-istio-kubeconfig\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361104    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pw6n\" (UniqueName: \"kubernetes.io/projected/0305a7b5-a638-405a-ad5b-244012c6386f-kube-api-access-4pw6n\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361113    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0305a7b5-a638-405a-ad5b-244012c6386f-cacerts\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.361193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.361121    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0305a7b5-a638-405a-ad5b-244012c6386f-local-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:07.888196 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888160    2563 generic.go:356] "Generic (PLEG): container finished" podID="0305a7b5-a638-405a-ad5b-244012c6386f" containerID="22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f" exitCode=2
Jul 20 19:06:07.888624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888203    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"
Jul 20 19:06:07.888624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" event={"ID":"0305a7b5-a638-405a-ad5b-244012c6386f","Type":"ContainerDied","Data":"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"}
Jul 20 19:06:07.888624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf" event={"ID":"0305a7b5-a638-405a-ad5b-244012c6386f","Type":"ContainerDied","Data":"fe8abec72019486024024f867209398d73de0a7a4dfdd93b448ea28987aceb23"}
Jul 20 19:06:07.888624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888329    2563 scope.go:117] "RemoveContainer" containerID="22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"
Jul 20 19:06:07.888971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.888950    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:07.889880 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.889863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf445pz6"
Jul 20 19:06:07.898156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.898141    2563 scope.go:117] "RemoveContainer" containerID="22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"
Jul 20 19:06:07.898403 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:06:07.898386    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f\": container with ID starting with 22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f not found: ID does not exist" containerID="22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"
Jul 20 19:06:07.898457 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.898410    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f"} err="failed to get container status \"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f\": rpc error: code = NotFound desc = could not find container \"22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f\": container with ID starting with 22314efcb9b83693c09a14ed7d495797766722404c3336e0b4a26fc644e7f95f not found: ID does not exist"
Jul 20 19:06:07.929100 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.929064    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:06:07.933051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.933032    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cbsvf"]
Jul 20 19:06:07.947397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:07.947372    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:08.021135 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:08.021110    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 20 19:06:08.021210 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:08.021156    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 20 19:06:08.428498 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:08.428459    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0305a7b5-a638-405a-ad5b-244012c6386f" path="/var/lib/kubelet/pods/0305a7b5-a638-405a-ad5b-244012c6386f/volumes"
Jul 20 19:06:09.021641 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:09.021605    2563 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 20 19:06:09.022022 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:09.021655    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 20 19:06:09.899181 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:09.899139    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy" containerID="cri-o://3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d" gracePeriod=30
Jul 20 19:06:15.136743 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.136720    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:15.320016 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.319993    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320045    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320081    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320113    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320375 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320169    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320375 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320205    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7dsk\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320375 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320264    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320375 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket\") pod \"00a43bb5-d48f-4381-835f-5f4173d94c2e\" (UID: \"00a43bb5-d48f-4381-835f-5f4173d94c2e\") "
Jul 20 19:06:15.320629 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:15.320629 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320497    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:06:15.320629 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320558    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.320829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:15.320829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320786    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:15.320829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.320797    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:15.322310 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.322284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:06:15.322397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.322314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk" (OuterVolumeSpecName: "kube-api-access-q7dsk") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "kube-api-access-q7dsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:06:15.322554 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.322530    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:06:15.322615 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.322600    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "00a43bb5-d48f-4381-835f-5f4173d94c2e" (UID: "00a43bb5-d48f-4381-835f-5f4173d94c2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:06:15.421555 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421527    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421555 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421552    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421567    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421579    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00a43bb5-d48f-4381-835f-5f4173d94c2e-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421591    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421602    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421615    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00a43bb5-d48f-4381-835f-5f4173d94c2e-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.421692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.421628    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7dsk\" (UniqueName: \"kubernetes.io/projected/00a43bb5-d48f-4381-835f-5f4173d94c2e-kube-api-access-q7dsk\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:15.929562 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.929529    2563 generic.go:356] "Generic (PLEG): container finished" podID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerID="3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d" exitCode=0
Jul 20 19:06:15.929685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.929567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" event={"ID":"00a43bb5-d48f-4381-835f-5f4173d94c2e","Type":"ContainerDied","Data":"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"}
Jul 20 19:06:15.929685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.929574    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"
Jul 20 19:06:15.929685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.929622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7" event={"ID":"00a43bb5-d48f-4381-835f-5f4173d94c2e","Type":"ContainerDied","Data":"d451f735ebeb445a89bdc5d419aee4168a2d59f2fa4abda2d0afe4d20f3f5177"}
Jul 20 19:06:15.929685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.929658    2563 scope.go:117] "RemoveContainer" containerID="3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"
Jul 20 19:06:15.938780 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.938743    2563 scope.go:117] "RemoveContainer" containerID="3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"
Jul 20 19:06:15.939020 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:06:15.938999    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d\": container with ID starting with 3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d not found: ID does not exist" containerID="3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"
Jul 20 19:06:15.939073 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.939031    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d"} err="failed to get container status \"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d\": rpc error: code = NotFound desc = could not find container \"3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d\": container with ID starting with 3bbf3b841d87d55f01b85a6eb1c26f4166e4fc71ae151abe7d8f6198b0c72b0d not found: ID does not exist"
Jul 20 19:06:15.951816 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.951793    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:15.954883 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:15.954862    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-r27v7"]
Jul 20 19:06:16.427393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:16.427362    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" path="/var/lib/kubelet/pods/00a43bb5-d48f-4381-835f-5f4173d94c2e/volumes"
Jul 20 19:06:32.853399 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:32.853330    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v8flf"
Jul 20 19:06:34.868467 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:34.868427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5lrvq"
Jul 20 19:06:46.716893 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.716854    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:46.717338 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717280    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy"
Jul 20 19:06:46.717338 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717300    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy"
Jul 20 19:06:46.717338 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717334    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0305a7b5-a638-405a-ad5b-244012c6386f" containerName="discovery"
Jul 20 19:06:46.717491 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717342    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0305a7b5-a638-405a-ad5b-244012c6386f" containerName="discovery"
Jul 20 19:06:46.717491 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="00a43bb5-d48f-4381-835f-5f4173d94c2e" containerName="istio-proxy"
Jul 20 19:06:46.717491 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.717450    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0305a7b5-a638-405a-ad5b-244012c6386f" containerName="discovery"
Jul 20 19:06:46.725405 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.725379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:46.728487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.728462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:06:46.728750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.728489    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6627t\""
Jul 20 19:06:46.728948 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.728568    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:06:46.730110 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.730087    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:46.842514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.842489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m\") pod \"kuadrant-operator-catalog-qntmh\" (UID: \"ab1ca172-2f2a-4305-8518-37ad0b0594d1\") " pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:46.943346 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.943319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m\") pod \"kuadrant-operator-catalog-qntmh\" (UID: \"ab1ca172-2f2a-4305-8518-37ad0b0594d1\") " pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:46.954679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:46.954653    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m\") pod \"kuadrant-operator-catalog-qntmh\" (UID: \"ab1ca172-2f2a-4305-8518-37ad0b0594d1\") " pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:47.037686 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.037663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:47.086193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.086168    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:47.166832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.166804    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:47.170217 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:06:47.170191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1ca172_2f2a_4305_8518_37ad0b0594d1.slice/crio-fbebf6b1dba89c7437b9cf15bea2814882b2f0dd44f74555ef310df6b3c0810c WatchSource:0}: Error finding container fbebf6b1dba89c7437b9cf15bea2814882b2f0dd44f74555ef310df6b3c0810c: Status 404 returned error can't find the container with id fbebf6b1dba89c7437b9cf15bea2814882b2f0dd44f74555ef310df6b3c0810c
Jul 20 19:06:47.314046 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.313990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ld6xl"]
Jul 20 19:06:47.316837 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.316820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:47.341581 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.341560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ld6xl"]
Jul 20 19:06:47.446790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.446766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6qnf\" (UniqueName: \"kubernetes.io/projected/3135ac5c-260e-484f-9a0a-c9f4a9288d32-kube-api-access-x6qnf\") pod \"kuadrant-operator-catalog-ld6xl\" (UID: \"3135ac5c-260e-484f-9a0a-c9f4a9288d32\") " pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:47.548003 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.547974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6qnf\" (UniqueName: \"kubernetes.io/projected/3135ac5c-260e-484f-9a0a-c9f4a9288d32-kube-api-access-x6qnf\") pod \"kuadrant-operator-catalog-ld6xl\" (UID: \"3135ac5c-260e-484f-9a0a-c9f4a9288d32\") " pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:47.557396 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.557375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6qnf\" (UniqueName: \"kubernetes.io/projected/3135ac5c-260e-484f-9a0a-c9f4a9288d32-kube-api-access-x6qnf\") pod \"kuadrant-operator-catalog-ld6xl\" (UID: \"3135ac5c-260e-484f-9a0a-c9f4a9288d32\") " pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:47.626456 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.626407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:47.746809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:47.746784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ld6xl"]
Jul 20 19:06:47.748811 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:06:47.748785    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3135ac5c_260e_484f_9a0a_c9f4a9288d32.slice/crio-248a654c3eeea0dc7db9d54de8ead895686036c0082f5077c6b40f7106d17181 WatchSource:0}: Error finding container 248a654c3eeea0dc7db9d54de8ead895686036c0082f5077c6b40f7106d17181: Status 404 returned error can't find the container with id 248a654c3eeea0dc7db9d54de8ead895686036c0082f5077c6b40f7106d17181
Jul 20 19:06:48.088164 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:48.088131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" event={"ID":"ab1ca172-2f2a-4305-8518-37ad0b0594d1","Type":"ContainerStarted","Data":"fbebf6b1dba89c7437b9cf15bea2814882b2f0dd44f74555ef310df6b3c0810c"}
Jul 20 19:06:48.089280 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:48.089257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl" event={"ID":"3135ac5c-260e-484f-9a0a-c9f4a9288d32","Type":"ContainerStarted","Data":"248a654c3eeea0dc7db9d54de8ead895686036c0082f5077c6b40f7106d17181"}
Jul 20 19:06:50.102732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.102688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" event={"ID":"ab1ca172-2f2a-4305-8518-37ad0b0594d1","Type":"ContainerStarted","Data":"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"}
Jul 20 19:06:50.103196 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.102749    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" podUID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" containerName="registry-server" containerID="cri-o://547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522" gracePeriod=2
Jul 20 19:06:50.104256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.104226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl" event={"ID":"3135ac5c-260e-484f-9a0a-c9f4a9288d32","Type":"ContainerStarted","Data":"088e845888453dd7d3028fde8f87190e1740f2cf291484ab6e374edf35a8eb55"}
Jul 20 19:06:50.120861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.120814    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" podStartSLOduration=1.3841169770000001 podStartE2EDuration="4.1208013s" totalImagesPullingTime="2.736684323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:50.120288228 +0000 UTC m=+370.301811419" watchObservedRunningTime="2026-07-20 19:06:50.1208013 +0000 UTC m=+370.302324489"
Jul 20 19:06:50.136385 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.136348    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl" podStartSLOduration=0.973475075 podStartE2EDuration="3.136335199s" totalImagesPullingTime="2.162860124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:50.135004278 +0000 UTC m=+370.316527492" watchObservedRunningTime="2026-07-20 19:06:50.136335199 +0000 UTC m=+370.317858387"
Jul 20 19:06:50.336619 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.336587    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:50.472496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.472436    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m\") pod \"ab1ca172-2f2a-4305-8518-37ad0b0594d1\" (UID: \"ab1ca172-2f2a-4305-8518-37ad0b0594d1\") "
Jul 20 19:06:50.474453 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.474434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m" (OuterVolumeSpecName: "kube-api-access-lfr5m") pod "ab1ca172-2f2a-4305-8518-37ad0b0594d1" (UID: "ab1ca172-2f2a-4305-8518-37ad0b0594d1"). InnerVolumeSpecName "kube-api-access-lfr5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:06:50.573055 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:50.573027    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfr5m\" (UniqueName: \"kubernetes.io/projected/ab1ca172-2f2a-4305-8518-37ad0b0594d1-kube-api-access-lfr5m\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:06:51.110084 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.110046    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" containerID="547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522" exitCode=0
Jul 20 19:06:51.110416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.110093    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qntmh"
Jul 20 19:06:51.110416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.110135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" event={"ID":"ab1ca172-2f2a-4305-8518-37ad0b0594d1","Type":"ContainerDied","Data":"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"}
Jul 20 19:06:51.110416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.110186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qntmh" event={"ID":"ab1ca172-2f2a-4305-8518-37ad0b0594d1","Type":"ContainerDied","Data":"fbebf6b1dba89c7437b9cf15bea2814882b2f0dd44f74555ef310df6b3c0810c"}
Jul 20 19:06:51.110416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.110214    2563 scope.go:117] "RemoveContainer" containerID="547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"
Jul 20 19:06:51.119630 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.119612    2563 scope.go:117] "RemoveContainer" containerID="547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"
Jul 20 19:06:51.119929 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:06:51.119907    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522\": container with ID starting with 547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522 not found: ID does not exist" containerID="547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"
Jul 20 19:06:51.119999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.119938    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522"} err="failed to get container status \"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522\": rpc error: code = NotFound desc = could not find container \"547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522\": container with ID starting with 547c4ab4d3f5805bc277f39c8a0ac839c08bd95cd75e49a56b0f808e8f99a522 not found: ID does not exist"
Jul 20 19:06:51.132430 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.132402    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:51.136209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:51.136186    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qntmh"]
Jul 20 19:06:52.427670 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:52.427628    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" path="/var/lib/kubelet/pods/ab1ca172-2f2a-4305-8518-37ad0b0594d1/volumes"
Jul 20 19:06:57.627530 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:57.627489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:57.628010 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:57.627553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:57.651832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:57.651805    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:06:58.170540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:06:58.170515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ld6xl"
Jul 20 19:07:01.925146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.925109    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"]
Jul 20 19:07:01.925611 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.925461    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" containerName="registry-server"
Jul 20 19:07:01.925611 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.925475    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" containerName="registry-server"
Jul 20 19:07:01.925611 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.925554    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1ca172-2f2a-4305-8518-37ad0b0594d1" containerName="registry-server"
Jul 20 19:07:01.929172 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.929150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:01.931911 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.931881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdzrm\""
Jul 20 19:07:01.938563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:01.938534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"]
Jul 20 19:07:02.055819 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.055792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.055912 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.055876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.055977 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.055908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86ggx\" (UniqueName: \"kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.157046 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.157020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.157151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.157052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86ggx\" (UniqueName: \"kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.157151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.157075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.157422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.157403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.157477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.157424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.168671 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.168648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86ggx\" (UniqueName: \"kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.240384 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.240319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:02.363673 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.363649    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"]
Jul 20 19:07:02.365628 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:02.365599    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec20362_1878_43db_94af_840e01232139.slice/crio-24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910 WatchSource:0}: Error finding container 24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910: Status 404 returned error can't find the container with id 24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910
Jul 20 19:07:02.729057 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.729028    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"]
Jul 20 19:07:02.731238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.731221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.743833 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.743809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"]
Jul 20 19:07:02.862571 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.862550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.862701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.862579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8x65\" (UniqueName: \"kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.862701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.862599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.963699 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.963672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.964031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.963705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8x65\" (UniqueName: \"kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.964031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.963728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.964108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.964060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.964108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.964095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:02.973105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:02.973082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8x65\" (UniqueName: \"kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:03.039912 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.039883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:03.123995 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.123932    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"]
Jul 20 19:07:03.128936 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.128915    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.135008 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.134984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"]
Jul 20 19:07:03.170200 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.170169    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ec20362-1878-43db-94af-840e01232139" containerID="52e4c2753c372965a91d101c351c44fef17d8e43363150725e4a9d10a68462a3" exitCode=0
Jul 20 19:07:03.170311 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.170204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw" event={"ID":"4ec20362-1878-43db-94af-840e01232139","Type":"ContainerDied","Data":"52e4c2753c372965a91d101c351c44fef17d8e43363150725e4a9d10a68462a3"}
Jul 20 19:07:03.170311 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.170262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw" event={"ID":"4ec20362-1878-43db-94af-840e01232139","Type":"ContainerStarted","Data":"24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910"}
Jul 20 19:07:03.179728 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.179705    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"]
Jul 20 19:07:03.181079 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:03.181053    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51977de3_b7bf_45ca_b903_4f85b043ab2a.slice/crio-297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3 WatchSource:0}: Error finding container 297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3: Status 404 returned error can't find the container with id 297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3
Jul 20 19:07:03.265624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.265597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.265733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.265693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dd9\" (UniqueName: \"kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.265851 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.265833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.366518 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.366463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.366518 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.366512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.366666 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.366544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dd9\" (UniqueName: \"kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.366893 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.366872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.366967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.366908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.376009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.375984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dd9\" (UniqueName: \"kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.440051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.440023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:03.564804 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.564778    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"]
Jul 20 19:07:03.569177 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:03.569124    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4da8d96_a5bd_4f2c_915d_19fe388ec9ef.slice/crio-b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233 WatchSource:0}: Error finding container b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233: Status 404 returned error can't find the container with id b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233
Jul 20 19:07:03.599231 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.599210    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"]
Jul 20 19:07:03.601504 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.601489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.610947 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.610928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"]
Jul 20 19:07:03.670482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.670453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.670482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.670485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqj5\" (UniqueName: \"kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.670700 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.670509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.771043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.771018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.771144 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.771049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqj5\" (UniqueName: \"kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.771144 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.771074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.771406 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.771379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.771488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.771389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.782535 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.782510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqj5\" (UniqueName: \"kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:03.930124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:03.930073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:04.051255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.051231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"]
Jul 20 19:07:04.053026 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:04.053003    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059bfe64_334d_4250_9837_f3c32c3c8305.slice/crio-d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee WatchSource:0}: Error finding container d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee: Status 404 returned error can't find the container with id d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee
Jul 20 19:07:04.176861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.176835    2563 generic.go:356] "Generic (PLEG): container finished" podID="059bfe64-334d-4250-9837-f3c32c3c8305" containerID="2e74b03b3ac2cd4d62b31c82ebb55a12c05f1e074974bd8b856ecae5be6f0fe9" exitCode=0
Jul 20 19:07:04.176978 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.176919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg" event={"ID":"059bfe64-334d-4250-9837-f3c32c3c8305","Type":"ContainerDied","Data":"2e74b03b3ac2cd4d62b31c82ebb55a12c05f1e074974bd8b856ecae5be6f0fe9"}
Jul 20 19:07:04.177036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.176981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg" event={"ID":"059bfe64-334d-4250-9837-f3c32c3c8305","Type":"ContainerStarted","Data":"d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee"}
Jul 20 19:07:04.178469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.178448    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerID="1dc5cd9ce018516fefd7acbb84ae339931dba51b0e499486027353504cb8edb8" exitCode=0
Jul 20 19:07:04.178583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.178533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz" event={"ID":"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef","Type":"ContainerDied","Data":"1dc5cd9ce018516fefd7acbb84ae339931dba51b0e499486027353504cb8edb8"}
Jul 20 19:07:04.178583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.178577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz" event={"ID":"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef","Type":"ContainerStarted","Data":"b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233"}
Jul 20 19:07:04.180398 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.180349    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ec20362-1878-43db-94af-840e01232139" containerID="dc5acdad266cc5f973dd9557cfa363dd56415024109ad6c9381fdbc8e47aa1d2" exitCode=0
Jul 20 19:07:04.180562 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.180429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw" event={"ID":"4ec20362-1878-43db-94af-840e01232139","Type":"ContainerDied","Data":"dc5acdad266cc5f973dd9557cfa363dd56415024109ad6c9381fdbc8e47aa1d2"}
Jul 20 19:07:04.182104 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.182083    2563 generic.go:356] "Generic (PLEG): container finished" podID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerID="9049098cf07a7fdd9459487bf6bda805f39c1432e7c2a119e88dc381be92ede5" exitCode=0
Jul 20 19:07:04.182187 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.182119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg" event={"ID":"51977de3-b7bf-45ca-b903-4f85b043ab2a","Type":"ContainerDied","Data":"9049098cf07a7fdd9459487bf6bda805f39c1432e7c2a119e88dc381be92ede5"}
Jul 20 19:07:04.182187 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:04.182146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg" event={"ID":"51977de3-b7bf-45ca-b903-4f85b043ab2a","Type":"ContainerStarted","Data":"297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3"}
Jul 20 19:07:05.192819 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:05.192780    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ec20362-1878-43db-94af-840e01232139" containerID="226d02636e69b742ad576262e4e38f1fedf1549f5b25e1ae0df40d74bf8fd28d" exitCode=0
Jul 20 19:07:05.193188 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:05.192853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw" event={"ID":"4ec20362-1878-43db-94af-840e01232139","Type":"ContainerDied","Data":"226d02636e69b742ad576262e4e38f1fedf1549f5b25e1ae0df40d74bf8fd28d"}
Jul 20 19:07:06.199638 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.199601    2563 generic.go:356] "Generic (PLEG): container finished" podID="059bfe64-334d-4250-9837-f3c32c3c8305" containerID="08aa739c777cd2dfcbcd9a71e968278aa033288b51e325c21077102bd052b1b1" exitCode=0
Jul 20 19:07:06.200036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.199681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg" event={"ID":"059bfe64-334d-4250-9837-f3c32c3c8305","Type":"ContainerDied","Data":"08aa739c777cd2dfcbcd9a71e968278aa033288b51e325c21077102bd052b1b1"}
Jul 20 19:07:06.201635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.201610    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerID="9ae33439c26c96dc367d1ea585d1ef6c10a26cd2d0795f37777348f0162c8496" exitCode=0
Jul 20 19:07:06.201728 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.201688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz" event={"ID":"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef","Type":"ContainerDied","Data":"9ae33439c26c96dc367d1ea585d1ef6c10a26cd2d0795f37777348f0162c8496"}
Jul 20 19:07:06.203643 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.203616    2563 generic.go:356] "Generic (PLEG): container finished" podID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerID="317df04fce672bf626bc469542fb067184da94bc7236abdbf9b456a767bf2600" exitCode=0
Jul 20 19:07:06.203750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.203659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg" event={"ID":"51977de3-b7bf-45ca-b903-4f85b043ab2a","Type":"ContainerDied","Data":"317df04fce672bf626bc469542fb067184da94bc7236abdbf9b456a767bf2600"}
Jul 20 19:07:06.516073 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.516046    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:06.593895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.593867    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86ggx\" (UniqueName: \"kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx\") pod \"4ec20362-1878-43db-94af-840e01232139\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") "
Jul 20 19:07:06.594020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.593909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util\") pod \"4ec20362-1878-43db-94af-840e01232139\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") "
Jul 20 19:07:06.594020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.593969    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle\") pod \"4ec20362-1878-43db-94af-840e01232139\" (UID: \"4ec20362-1878-43db-94af-840e01232139\") "
Jul 20 19:07:06.594448 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.594422    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle" (OuterVolumeSpecName: "bundle") pod "4ec20362-1878-43db-94af-840e01232139" (UID: "4ec20362-1878-43db-94af-840e01232139"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:06.595868 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.595839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx" (OuterVolumeSpecName: "kube-api-access-86ggx") pod "4ec20362-1878-43db-94af-840e01232139" (UID: "4ec20362-1878-43db-94af-840e01232139"). InnerVolumeSpecName "kube-api-access-86ggx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:06.599914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.599893    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util" (OuterVolumeSpecName: "util") pod "4ec20362-1878-43db-94af-840e01232139" (UID: "4ec20362-1878-43db-94af-840e01232139"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:06.695301 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.695276    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86ggx\" (UniqueName: \"kubernetes.io/projected/4ec20362-1878-43db-94af-840e01232139-kube-api-access-86ggx\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:06.695301 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.695298    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:06.695413 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:06.695307    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ec20362-1878-43db-94af-840e01232139-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:07.210214 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.210190    2563 generic.go:356] "Generic (PLEG): container finished" podID="059bfe64-334d-4250-9837-f3c32c3c8305" containerID="9d2990771ae4f1c4b3a494386751152114932e76c6f460d0cb19dfa9858defca" exitCode=0
Jul 20 19:07:07.210501 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.210272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg" event={"ID":"059bfe64-334d-4250-9837-f3c32c3c8305","Type":"ContainerDied","Data":"9d2990771ae4f1c4b3a494386751152114932e76c6f460d0cb19dfa9858defca"}
Jul 20 19:07:07.212206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.212185    2563 generic.go:356] "Generic (PLEG): container finished" podID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerID="6e3607c704c6ed7e073d3900bd261af85746f696cd8fe10eab92f2fb71816276" exitCode=0
Jul 20 19:07:07.212305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.212270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz" event={"ID":"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef","Type":"ContainerDied","Data":"6e3607c704c6ed7e073d3900bd261af85746f696cd8fe10eab92f2fb71816276"}
Jul 20 19:07:07.213870 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.213844    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw"
Jul 20 19:07:07.213976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.213843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw" event={"ID":"4ec20362-1878-43db-94af-840e01232139","Type":"ContainerDied","Data":"24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910"}
Jul 20 19:07:07.213976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.213941    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24b9a79cee2fa0db30ff3fc1153a466a51fee82d2b04c90869f15945bb793910"
Jul 20 19:07:07.215805 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.215786    2563 generic.go:356] "Generic (PLEG): container finished" podID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerID="0d9f1abce8c3b7690f5a044b9542f495ef45e8c32309f17d3dd1ec8fdce22349" exitCode=0
Jul 20 19:07:07.215917 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:07.215818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg" event={"ID":"51977de3-b7bf-45ca-b903-4f85b043ab2a","Type":"ContainerDied","Data":"0d9f1abce8c3b7690f5a044b9542f495ef45e8c32309f17d3dd1ec8fdce22349"}
Jul 20 19:07:08.394151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.394130    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:08.396388 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.396366    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:08.419507 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.419489    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:08.511340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511319    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle\") pod \"51977de3-b7bf-45ca-b903-4f85b043ab2a\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") "
Jul 20 19:07:08.511471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util\") pod \"51977de3-b7bf-45ca-b903-4f85b043ab2a\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") "
Jul 20 19:07:08.511471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftqj5\" (UniqueName: \"kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5\") pod \"059bfe64-334d-4250-9837-f3c32c3c8305\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") "
Jul 20 19:07:08.511471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5dd9\" (UniqueName: \"kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9\") pod \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") "
Jul 20 19:07:08.511471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511462    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8x65\" (UniqueName: \"kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65\") pod \"51977de3-b7bf-45ca-b903-4f85b043ab2a\" (UID: \"51977de3-b7bf-45ca-b903-4f85b043ab2a\") "
Jul 20 19:07:08.511700 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle\") pod \"059bfe64-334d-4250-9837-f3c32c3c8305\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") "
Jul 20 19:07:08.511700 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511552    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util\") pod \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") "
Jul 20 19:07:08.511700 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511580    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle\") pod \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\" (UID: \"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef\") "
Jul 20 19:07:08.511700 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511627    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util\") pod \"059bfe64-334d-4250-9837-f3c32c3c8305\" (UID: \"059bfe64-334d-4250-9837-f3c32c3c8305\") "
Jul 20 19:07:08.512648 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.511988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle" (OuterVolumeSpecName: "bundle") pod "51977de3-b7bf-45ca-b903-4f85b043ab2a" (UID: "51977de3-b7bf-45ca-b903-4f85b043ab2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.512648 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.512576    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle" (OuterVolumeSpecName: "bundle") pod "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" (UID: "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.512819 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.512780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle" (OuterVolumeSpecName: "bundle") pod "059bfe64-334d-4250-9837-f3c32c3c8305" (UID: "059bfe64-334d-4250-9837-f3c32c3c8305"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.513868 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.513843    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5" (OuterVolumeSpecName: "kube-api-access-ftqj5") pod "059bfe64-334d-4250-9837-f3c32c3c8305" (UID: "059bfe64-334d-4250-9837-f3c32c3c8305"). InnerVolumeSpecName "kube-api-access-ftqj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:08.514018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.514000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9" (OuterVolumeSpecName: "kube-api-access-v5dd9") pod "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" (UID: "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef"). InnerVolumeSpecName "kube-api-access-v5dd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:08.514133 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.514114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65" (OuterVolumeSpecName: "kube-api-access-b8x65") pod "51977de3-b7bf-45ca-b903-4f85b043ab2a" (UID: "51977de3-b7bf-45ca-b903-4f85b043ab2a"). InnerVolumeSpecName "kube-api-access-b8x65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:08.517526 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.517504    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util" (OuterVolumeSpecName: "util") pod "51977de3-b7bf-45ca-b903-4f85b043ab2a" (UID: "51977de3-b7bf-45ca-b903-4f85b043ab2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.518026 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.518003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util" (OuterVolumeSpecName: "util") pod "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" (UID: "b4da8d96-a5bd-4f2c-915d-19fe388ec9ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.518345 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.518326    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util" (OuterVolumeSpecName: "util") pod "059bfe64-334d-4250-9837-f3c32c3c8305" (UID: "059bfe64-334d-4250-9837-f3c32c3c8305"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:08.613117 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613096    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5dd9\" (UniqueName: \"kubernetes.io/projected/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-kube-api-access-v5dd9\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613117 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613116    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8x65\" (UniqueName: \"kubernetes.io/projected/51977de3-b7bf-45ca-b903-4f85b043ab2a-kube-api-access-b8x65\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613125    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613135    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613143    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4da8d96-a5bd-4f2c-915d-19fe388ec9ef-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613150    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/059bfe64-334d-4250-9837-f3c32c3c8305-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613157    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-bundle\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613163    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51977de3-b7bf-45ca-b903-4f85b043ab2a-util\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:08.613228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:08.613171    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftqj5\" (UniqueName: \"kubernetes.io/projected/059bfe64-334d-4250-9837-f3c32c3c8305-kube-api-access-ftqj5\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:09.226809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.226774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg"
Jul 20 19:07:09.226809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.226785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg" event={"ID":"059bfe64-334d-4250-9837-f3c32c3c8305","Type":"ContainerDied","Data":"d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee"}
Jul 20 19:07:09.227044 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.226835    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d606577df9712476c4055fb4b1c283a538ce8a96016f5dd84704f98869bc64ee"
Jul 20 19:07:09.228714 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.228697    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz"
Jul 20 19:07:09.228841 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.228727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz" event={"ID":"b4da8d96-a5bd-4f2c-915d-19fe388ec9ef","Type":"ContainerDied","Data":"b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233"}
Jul 20 19:07:09.228841 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.228786    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0f7c8c92953788172b85b7f0c93c34bf0382e25b7fdd929cd3671e72c0a3233"
Jul 20 19:07:09.237262 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.237239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg" event={"ID":"51977de3-b7bf-45ca-b903-4f85b043ab2a","Type":"ContainerDied","Data":"297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3"}
Jul 20 19:07:09.237359 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.237286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg"
Jul 20 19:07:09.237359 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:09.237295    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="297e81329c66c0f3c61475cb7e899d9a7e4364722e46195171075690772616e3"
Jul 20 19:07:16.241120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c677d4dfb-679bz"]
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241419    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="util"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241430    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="util"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241439    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="util"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241445    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="util"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241452    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="extract"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241458    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="extract"
Jul 20 19:07:16.241466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241468    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241474    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241486    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241491    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241497    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="util"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241502    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="util"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241509    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="util"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241514    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="util"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241522    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241527    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241533    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241537    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241543    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241548    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="pull"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241553    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241560    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241566    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241571    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241616    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4da8d96-a5bd-4f2c-915d-19fe388ec9ef" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241623    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec20362-1878-43db-94af-840e01232139" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241630    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="059bfe64-334d-4250-9837-f3c32c3c8305" containerName="extract"
Jul 20 19:07:16.241683 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.241636    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="51977de3-b7bf-45ca-b903-4f85b043ab2a" containerName="extract"
Jul 20 19:07:16.244477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.244461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.248747 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 19:07:16.248944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 19:07:16.248944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248818    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 19:07:16.248944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 19:07:16.248944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248864    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 19:07:16.248944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248866    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gf4mx\""
Jul 20 19:07:16.249164 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.248997    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 19:07:16.249241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.249228    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 19:07:16.253238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.253217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 19:07:16.258661 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.258640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c677d4dfb-679bz"]
Jul 20 19:07:16.375815 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.375778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-console-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.375825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-oauth-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.375884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-service-ca\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.375946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.375985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-trusted-ca-bundle\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376182 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.376024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-oauth-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.376182 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.376048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2wp\" (UniqueName: \"kubernetes.io/projected/ebaf701c-3352-4324-839b-21ff12e4f167-kube-api-access-qp2wp\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.476981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-service-ca\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-trusted-ca-bundle\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-oauth-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2wp\" (UniqueName: \"kubernetes.io/projected/ebaf701c-3352-4324-839b-21ff12e4f167-kube-api-access-qp2wp\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477297 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-console-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477297 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-oauth-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477803 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-service-ca\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.477942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477924    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-console-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.478011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-oauth-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.478011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.477990    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebaf701c-3352-4324-839b-21ff12e4f167-trusted-ca-bundle\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.480087 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.480067    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-oauth-config\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.480087 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.480083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebaf701c-3352-4324-839b-21ff12e4f167-console-serving-cert\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.486189 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.486166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2wp\" (UniqueName: \"kubernetes.io/projected/ebaf701c-3352-4324-839b-21ff12e4f167-kube-api-access-qp2wp\") pod \"console-7c677d4dfb-679bz\" (UID: \"ebaf701c-3352-4324-839b-21ff12e4f167\") " pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.554860 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.554833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:16.683181 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:16.683154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c677d4dfb-679bz"]
Jul 20 19:07:16.684405 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:16.684381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebaf701c_3352_4324_839b_21ff12e4f167.slice/crio-78980970d5de573b758f3f5697851129c51d38d55215e40ca3ae7ac2c4e000d1 WatchSource:0}: Error finding container 78980970d5de573b758f3f5697851129c51d38d55215e40ca3ae7ac2c4e000d1: Status 404 returned error can't find the container with id 78980970d5de573b758f3f5697851129c51d38d55215e40ca3ae7ac2c4e000d1
Jul 20 19:07:17.277410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:17.277372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c677d4dfb-679bz" event={"ID":"ebaf701c-3352-4324-839b-21ff12e4f167","Type":"ContainerStarted","Data":"49e3b5c588592fda4b7fb642e898e1fa7c34c59c488bb34e269c9208936c1200"}
Jul 20 19:07:17.277820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:17.277424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c677d4dfb-679bz" event={"ID":"ebaf701c-3352-4324-839b-21ff12e4f167","Type":"ContainerStarted","Data":"78980970d5de573b758f3f5697851129c51d38d55215e40ca3ae7ac2c4e000d1"}
Jul 20 19:07:17.299441 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:17.299397    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c677d4dfb-679bz" podStartSLOduration=1.299382573 podStartE2EDuration="1.299382573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:17.29758719 +0000 UTC m=+397.479110399" watchObservedRunningTime="2026-07-20 19:07:17.299382573 +0000 UTC m=+397.480905762"
Jul 20 19:07:19.848928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:19.848899    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"]
Jul 20 19:07:19.852001 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:19.851983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:19.854553 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:19.854523    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6rzbt\""
Jul 20 19:07:19.866626 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:19.866604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"]
Jul 20 19:07:20.005030 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.005002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.005225 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.005042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7tq\" (UniqueName: \"kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.106123 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.106094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.106250 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.106131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7tq\" (UniqueName: \"kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.106515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.106496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.115902 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.115876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7tq\" (UniqueName: \"kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.162197 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.162175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:20.294156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:20.294130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"]
Jul 20 19:07:20.295496 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:20.295464    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca198d2c_c20c_45e8_9a7d_120a53a705d1.slice/crio-3883d246fd2806a2599bec27c2f09cf8916e1700f70cd297dcd915cc184a2e32 WatchSource:0}: Error finding container 3883d246fd2806a2599bec27c2f09cf8916e1700f70cd297dcd915cc184a2e32: Status 404 returned error can't find the container with id 3883d246fd2806a2599bec27c2f09cf8916e1700f70cd297dcd915cc184a2e32
Jul 20 19:07:21.299392 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.299357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd" event={"ID":"ca198d2c-c20c-45e8-9a7d-120a53a705d1","Type":"ContainerStarted","Data":"3883d246fd2806a2599bec27c2f09cf8916e1700f70cd297dcd915cc184a2e32"}
Jul 20 19:07:21.860086 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.860048    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"]
Jul 20 19:07:21.862600 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.862580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:21.865520 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.865494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ntshg\""
Jul 20 19:07:21.865876 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.865862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 19:07:21.874990 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:21.874967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"]
Jul 20 19:07:22.020879 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:22.020854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht95h\" (UniqueName: \"kubernetes.io/projected/458a99d6-2a51-49dd-b718-00379971e243-kube-api-access-ht95h\") pod \"dns-operator-controller-manager-864dd78c4c-76zwb\" (UID: \"458a99d6-2a51-49dd-b718-00379971e243\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:22.121581 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:22.121529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht95h\" (UniqueName: \"kubernetes.io/projected/458a99d6-2a51-49dd-b718-00379971e243-kube-api-access-ht95h\") pod \"dns-operator-controller-manager-864dd78c4c-76zwb\" (UID: \"458a99d6-2a51-49dd-b718-00379971e243\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:22.130366 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:22.130343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht95h\" (UniqueName: \"kubernetes.io/projected/458a99d6-2a51-49dd-b718-00379971e243-kube-api-access-ht95h\") pod \"dns-operator-controller-manager-864dd78c4c-76zwb\" (UID: \"458a99d6-2a51-49dd-b718-00379971e243\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:22.173384 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:22.173363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:22.319980 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:22.319951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"]
Jul 20 19:07:22.320963 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:22.320919    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458a99d6_2a51_49dd_b718_00379971e243.slice/crio-871272203ef0b55c89f4c684ec96ebcbb1f3b6f0d9635dcc40576fd79436adc3 WatchSource:0}: Error finding container 871272203ef0b55c89f4c684ec96ebcbb1f3b6f0d9635dcc40576fd79436adc3: Status 404 returned error can't find the container with id 871272203ef0b55c89f4c684ec96ebcbb1f3b6f0d9635dcc40576fd79436adc3
Jul 20 19:07:23.313218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:23.313175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb" event={"ID":"458a99d6-2a51-49dd-b718-00379971e243","Type":"ContainerStarted","Data":"871272203ef0b55c89f4c684ec96ebcbb1f3b6f0d9635dcc40576fd79436adc3"}
Jul 20 19:07:24.613469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.613439    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"]
Jul 20 19:07:24.616976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.616956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:24.620321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.620293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rjjzx\""
Jul 20 19:07:24.628612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.628578    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"]
Jul 20 19:07:24.743847 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.743794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shf97\" (UniqueName: \"kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97\") pod \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" (UID: \"d041433e-cdd0-4893-a680-acccf2e4c709\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:24.844572 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.844538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shf97\" (UniqueName: \"kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97\") pod \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" (UID: \"d041433e-cdd0-4893-a680-acccf2e4c709\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:24.857114 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.857085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shf97\" (UniqueName: \"kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97\") pod \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" (UID: \"d041433e-cdd0-4893-a680-acccf2e4c709\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:24.929155 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:24.929070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:25.286586 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:25.286563    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"]
Jul 20 19:07:25.287913 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:25.287889    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd041433e_cdd0_4893_a680_acccf2e4c709.slice/crio-239116e06c9f65c79a7cc86492990000d03620d3460a1bba5f02798d39b43e11 WatchSource:0}: Error finding container 239116e06c9f65c79a7cc86492990000d03620d3460a1bba5f02798d39b43e11: Status 404 returned error can't find the container with id 239116e06c9f65c79a7cc86492990000d03620d3460a1bba5f02798d39b43e11
Jul 20 19:07:25.325030 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:25.325004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb" event={"ID":"458a99d6-2a51-49dd-b718-00379971e243","Type":"ContainerStarted","Data":"96256da0761a898c637ecbb3a38b82e564714b57a08ba93557559d0c3404d264"}
Jul 20 19:07:25.325145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:25.325077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:25.326342 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:25.326323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j" event={"ID":"d041433e-cdd0-4893-a680-acccf2e4c709","Type":"ContainerStarted","Data":"239116e06c9f65c79a7cc86492990000d03620d3460a1bba5f02798d39b43e11"}
Jul 20 19:07:25.343911 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:25.343870    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb" podStartSLOduration=1.455391282 podStartE2EDuration="4.343855348s" totalImagesPullingTime="2.888464066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:25.341340304 +0000 UTC m=+405.522863484" watchObservedRunningTime="2026-07-20 19:07:25.343855348 +0000 UTC m=+405.525378537"
Jul 20 19:07:26.555790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:26.555741    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:26.556214 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:26.555822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:26.562303 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:26.562278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:27.347056 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:27.347024    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c677d4dfb-679bz"
Jul 20 19:07:28.176432 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.176399    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"]
Jul 20 19:07:28.179886 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.179869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:28.184598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.184578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-flqrm\""
Jul 20 19:07:28.191532 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.191506    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"]
Jul 20 19:07:28.275962 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.275928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9p2\" (UniqueName: \"kubernetes.io/projected/35163c8d-52be-47ab-b29b-d697a487dae4-kube-api-access-jl9p2\") pod \"authorino-operator-75cc8d5cb7-mtvgj\" (UID: \"35163c8d-52be-47ab-b29b-d697a487dae4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:28.349582 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.349488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd" event={"ID":"ca198d2c-c20c-45e8-9a7d-120a53a705d1","Type":"ContainerStarted","Data":"ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588"}
Jul 20 19:07:28.349746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.349592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:28.351245 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.351215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j" event={"ID":"d041433e-cdd0-4893-a680-acccf2e4c709","Type":"ContainerStarted","Data":"186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1"}
Jul 20 19:07:28.351479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.351460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:28.367236 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.367188    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd" podStartSLOduration=1.6101730600000002 podStartE2EDuration="9.36716981s" totalImagesPullingTime="7.75699675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:28.366158681 +0000 UTC m=+408.547681896" watchObservedRunningTime="2026-07-20 19:07:28.36716981 +0000 UTC m=+408.548693004"
Jul 20 19:07:28.377142 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.377121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9p2\" (UniqueName: \"kubernetes.io/projected/35163c8d-52be-47ab-b29b-d697a487dae4-kube-api-access-jl9p2\") pod \"authorino-operator-75cc8d5cb7-mtvgj\" (UID: \"35163c8d-52be-47ab-b29b-d697a487dae4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:28.385856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.385813    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j" podStartSLOduration=1.627014414 podStartE2EDuration="4.385798632s" totalImagesPullingTime="2.758784218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:28.383917209 +0000 UTC m=+408.565440411" watchObservedRunningTime="2026-07-20 19:07:28.385798632 +0000 UTC m=+408.567321822"
Jul 20 19:07:28.389029 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.389001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9p2\" (UniqueName: \"kubernetes.io/projected/35163c8d-52be-47ab-b29b-d697a487dae4-kube-api-access-jl9p2\") pod \"authorino-operator-75cc8d5cb7-mtvgj\" (UID: \"35163c8d-52be-47ab-b29b-d697a487dae4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:28.490591 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.490558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:28.630536 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:28.630510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"]
Jul 20 19:07:28.632061 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:28.632034    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35163c8d_52be_47ab_b29b_d697a487dae4.slice/crio-b4f465383e9c4e96d8304741d9ea710c188745ac738c801a19e1b02e182d44d8 WatchSource:0}: Error finding container b4f465383e9c4e96d8304741d9ea710c188745ac738c801a19e1b02e182d44d8: Status 404 returned error can't find the container with id b4f465383e9c4e96d8304741d9ea710c188745ac738c801a19e1b02e182d44d8
Jul 20 19:07:29.359625 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:29.359584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj" event={"ID":"35163c8d-52be-47ab-b29b-d697a487dae4","Type":"ContainerStarted","Data":"b4f465383e9c4e96d8304741d9ea710c188745ac738c801a19e1b02e182d44d8"}
Jul 20 19:07:31.373133 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:31.373096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj" event={"ID":"35163c8d-52be-47ab-b29b-d697a487dae4","Type":"ContainerStarted","Data":"ae999a8f93eb7405661bf2d6356bbf4d56430366534c7c07ffa21be3a37630df"}
Jul 20 19:07:31.373493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:31.373195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:31.391598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:31.391555    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj" podStartSLOduration=1.181220963 podStartE2EDuration="3.391540073s" totalImagesPullingTime="2.21031911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:31.389157538 +0000 UTC m=+411.570680748" watchObservedRunningTime="2026-07-20 19:07:31.391540073 +0000 UTC m=+411.573063306"
Jul 20 19:07:36.338398 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:36.338358    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-76zwb"
Jul 20 19:07:39.361749 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:39.361711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:39.362262 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:39.361989    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:40.809931 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.809894    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"]
Jul 20 19:07:40.815234 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.815211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.825950 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.825921    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"]
Jul 20 19:07:40.873479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.873454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.873580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.873508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcx72\" (UniqueName: \"kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.974686 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.974655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcx72\" (UniqueName: \"kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.974842 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.974710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.975045 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.975028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:40.989009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:40.988989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcx72\" (UniqueName: \"kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72\") pod \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.126352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.126288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.265853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.265817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"]
Jul 20 19:07:41.323337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.323314    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"]
Jul 20 19:07:41.330455 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.330433    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"]
Jul 20 19:07:41.344439 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.344411    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:07:41.344813 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.344798    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" containerName="manager"
Jul 20 19:07:41.344813 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.344813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" containerName="manager"
Jul 20 19:07:41.344940 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.344872    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" containerName="manager"
Jul 20 19:07:41.348160 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.348139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.361086 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.361062    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"]
Jul 20 19:07:41.361256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.361235    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" containerName="manager" containerID="cri-o://ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588" gracePeriod=2
Jul 20 19:07:41.363889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.363868    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:07:41.369212 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.369146    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"]
Jul 20 19:07:41.378129 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.378062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.378129 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.378103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dl2l\" (UniqueName: \"kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.381813 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.381794    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"]
Jul 20 19:07:41.381971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.381952    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" containerName="manager" containerID="cri-o://186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1" gracePeriod=2
Jul 20 19:07:41.385329 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.385306    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"]
Jul 20 19:07:41.394254 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.394222    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.396321 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.396290    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.411782 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.411735    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"]
Jul 20 19:07:41.412252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412236    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" containerName="manager"
Jul 20 19:07:41.412320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412255    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" containerName="manager"
Jul 20 19:07:41.412320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412291    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" containerName="manager"
Jul 20 19:07:41.412320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412300    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" containerName="manager"
Jul 20 19:07:41.412454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412392    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" containerName="manager"
Jul 20 19:07:41.412454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.412405    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" containerName="manager"
Jul 20 19:07:41.415679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.415662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:41.425670 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.425642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"]
Jul 20 19:07:41.430136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.430099    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" containerName="manager" containerID="cri-o://a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921" gracePeriod=2
Jul 20 19:07:41.437173 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.437147    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.439433 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.439410    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.441788 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.441748    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.446744 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.446721    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.449011 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.448980    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.479033 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.479011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.479131 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.479050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dl2l\" (UniqueName: \"kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.479131 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.479125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5wgl\" (UniqueName: \"kubernetes.io/projected/b7427d9a-543d-4b36-9f06-7c4a5c76585d-kube-api-access-m5wgl\") pod \"limitador-operator-controller-manager-859d7b78bd-zdcr7\" (UID: \"b7427d9a-543d-4b36-9f06-7c4a5c76585d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:41.479319 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.479298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.488634 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.488613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dl2l\" (UniqueName: \"kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l\") pod \"kuadrant-operator-controller-manager-55467d9f7-j65ng\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.581236 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.581196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5wgl\" (UniqueName: \"kubernetes.io/projected/b7427d9a-543d-4b36-9f06-7c4a5c76585d-kube-api-access-m5wgl\") pod \"limitador-operator-controller-manager-859d7b78bd-zdcr7\" (UID: \"b7427d9a-543d-4b36-9f06-7c4a5c76585d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:41.590950 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.590920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5wgl\" (UniqueName: \"kubernetes.io/projected/b7427d9a-543d-4b36-9f06-7c4a5c76585d-kube-api-access-m5wgl\") pod \"limitador-operator-controller-manager-859d7b78bd-zdcr7\" (UID: \"b7427d9a-543d-4b36-9f06-7c4a5c76585d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:41.658945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.658919    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.661069 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.661036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:41.661282 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.661251    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.663426 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.663393    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.665526 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.665498    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.676826 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.676806    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.679268 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.679245    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.681377 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.681350    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.681567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.681551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shf97\" (UniqueName: \"kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97\") pod \"d041433e-cdd0-4893-a680-acccf2e4c709\" (UID: \"d041433e-cdd0-4893-a680-acccf2e4c709\") "
Jul 20 19:07:41.683599 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.683570    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97" (OuterVolumeSpecName: "kube-api-access-shf97") pod "d041433e-cdd0-4893-a680-acccf2e4c709" (UID: "d041433e-cdd0-4893-a680-acccf2e4c709"). InnerVolumeSpecName "kube-api-access-shf97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:41.683839 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.683817    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.686651 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.686632    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.689039 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.689018    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:41.693640 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.693613    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:41.695929 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:41.695907    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:41.782464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcx72\" (UniqueName: \"kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72\") pod \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") "
Jul 20 19:07:41.782579 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782470    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume\") pod \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\" (UID: \"a7f9f1c5-8776-437e-ad42-6c2fec5806e9\") "
Jul 20 19:07:41.782617 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782598    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj7tq\" (UniqueName: \"kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq\") pod \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") "
Jul 20 19:07:41.782669 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume\") pod \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\" (UID: \"ca198d2c-c20c-45e8-9a7d-120a53a705d1\") "
Jul 20 19:07:41.782737 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7f9f1c5-8776-437e-ad42-6c2fec5806e9" (UID: "a7f9f1c5-8776-437e-ad42-6c2fec5806e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:41.782873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782859    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shf97\" (UniqueName: \"kubernetes.io/projected/d041433e-cdd0-4893-a680-acccf2e4c709-kube-api-access-shf97\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.782938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.782875    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-extensions-socket-volume\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.783053 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.783032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca198d2c-c20c-45e8-9a7d-120a53a705d1" (UID: "ca198d2c-c20c-45e8-9a7d-120a53a705d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:07:41.784386 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.784367    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72" (OuterVolumeSpecName: "kube-api-access-hcx72") pod "a7f9f1c5-8776-437e-ad42-6c2fec5806e9" (UID: "a7f9f1c5-8776-437e-ad42-6c2fec5806e9"). InnerVolumeSpecName "kube-api-access-hcx72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:41.784557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.784538    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq" (OuterVolumeSpecName: "kube-api-access-wj7tq") pod "ca198d2c-c20c-45e8-9a7d-120a53a705d1" (UID: "ca198d2c-c20c-45e8-9a7d-120a53a705d1"). InnerVolumeSpecName "kube-api-access-wj7tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:41.800487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.800467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:07:41.801649 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:41.801627    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f25050_5e2d_4a19_9344_2c40735b94c6.slice/crio-6efeaa1ee296663495392776f600f707fc6dd0c4bafaa1b58d54c09fefad5d4c WatchSource:0}: Error finding container 6efeaa1ee296663495392776f600f707fc6dd0c4bafaa1b58d54c09fefad5d4c: Status 404 returned error can't find the container with id 6efeaa1ee296663495392776f600f707fc6dd0c4bafaa1b58d54c09fefad5d4c
Jul 20 19:07:41.842504 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.842486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:41.884204 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.884177    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcx72\" (UniqueName: \"kubernetes.io/projected/a7f9f1c5-8776-437e-ad42-6c2fec5806e9-kube-api-access-hcx72\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.884204 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.884201    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj7tq\" (UniqueName: \"kubernetes.io/projected/ca198d2c-c20c-45e8-9a7d-120a53a705d1-kube-api-access-wj7tq\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.884390 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.884216    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca198d2c-c20c-45e8-9a7d-120a53a705d1-extensions-socket-volume\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:07:41.980374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:41.980343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"]
Jul 20 19:07:41.981998 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:41.981965    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7427d9a_543d_4b36_9f06_7c4a5c76585d.slice/crio-d825a7c76c7c9d6505b9f356cc5df635dc1eca3579a596c5b20757d56d046160 WatchSource:0}: Error finding container d825a7c76c7c9d6505b9f356cc5df635dc1eca3579a596c5b20757d56d046160: Status 404 returned error can't find the container with id d825a7c76c7c9d6505b9f356cc5df635dc1eca3579a596c5b20757d56d046160
Jul 20 19:07:42.380593 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.380564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mtvgj"
Jul 20 19:07:42.383427 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.383401    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:42.385719 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.385690    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cwtxd\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:42.388243 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.388222    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-q9v6j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:42.427094 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.427061    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" path="/var/lib/kubelet/pods/a7f9f1c5-8776-437e-ad42-6c2fec5806e9/volumes"
Jul 20 19:07:42.427447 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.427430    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" path="/var/lib/kubelet/pods/ca198d2c-c20c-45e8-9a7d-120a53a705d1/volumes"
Jul 20 19:07:42.427773 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.427744    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d041433e-cdd0-4893-a680-acccf2e4c709" path="/var/lib/kubelet/pods/d041433e-cdd0-4893-a680-acccf2e4c709/volumes"
Jul 20 19:07:42.438188 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.438159    2563 generic.go:356] "Generic (PLEG): container finished" podID="d041433e-cdd0-4893-a680-acccf2e4c709" containerID="186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1" exitCode=0
Jul 20 19:07:42.438306 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.438205    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q9v6j"
Jul 20 19:07:42.438306 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.438255    2563 scope.go:117] "RemoveContainer" containerID="186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1"
Jul 20 19:07:42.440283 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.440261    2563 generic.go:356] "Generic (PLEG): container finished" podID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" containerID="a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921" exitCode=2
Jul 20 19:07:42.440391 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.440311    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:42.443143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.442976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" event={"ID":"b2f25050-5e2d-4a19-9344-2c40735b94c6","Type":"ContainerStarted","Data":"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"}
Jul 20 19:07:42.443143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.443026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" event={"ID":"b2f25050-5e2d-4a19-9344-2c40735b94c6","Type":"ContainerStarted","Data":"6efeaa1ee296663495392776f600f707fc6dd0c4bafaa1b58d54c09fefad5d4c"}
Jul 20 19:07:42.443143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.443090    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:42.444656 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.444632    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca198d2c-c20c-45e8-9a7d-120a53a705d1" containerID="ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588" exitCode=0
Jul 20 19:07:42.445463 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.444675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cwtxd"
Jul 20 19:07:42.447690 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.446842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7" event={"ID":"b7427d9a-543d-4b36-9f06-7c4a5c76585d","Type":"ContainerStarted","Data":"6e5da05ca38ad449bc0bcf17754fb83c1616dbf6534ae2fe5b32e65a5ed05a49"}
Jul 20 19:07:42.447690 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.446885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7" event={"ID":"b7427d9a-543d-4b36-9f06-7c4a5c76585d","Type":"ContainerStarted","Data":"d825a7c76c7c9d6505b9f356cc5df635dc1eca3579a596c5b20757d56d046160"}
Jul 20 19:07:42.447690 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.447276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:42.452105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.452053    2563 scope.go:117] "RemoveContainer" containerID="186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1"
Jul 20 19:07:42.452327 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.452294    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1\": container with ID starting with 186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1 not found: ID does not exist" containerID="186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1"
Jul 20 19:07:42.452392 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.452325    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1"} err="failed to get container status \"186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1\": rpc error: code = NotFound desc = could not find container \"186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1\": container with ID starting with 186e5737ef67488e92290c202916fc9a48d2f8b810f22296344cf8fbbca6e1f1 not found: ID does not exist"
Jul 20 19:07:42.452392 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.452347    2563 scope.go:117] "RemoveContainer" containerID="a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921"
Jul 20 19:07:42.461223 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.461206    2563 scope.go:117] "RemoveContainer" containerID="a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921"
Jul 20 19:07:42.461474 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.461454    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921\": container with ID starting with a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921 not found: ID does not exist" containerID="a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921"
Jul 20 19:07:42.461542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.461479    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921"} err="failed to get container status \"a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921\": rpc error: code = NotFound desc = could not find container \"a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921\": container with ID starting with a3777326e70c0f1a37d5c41253b056da08cbba044bd9a3828ae7295dfe768921 not found: ID does not exist"
Jul 20 19:07:42.461542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.461497    2563 scope.go:117] "RemoveContainer" containerID="ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588"
Jul 20 19:07:42.469529 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.469513    2563 scope.go:117] "RemoveContainer" containerID="ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588"
Jul 20 19:07:42.469670 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.469631    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" podStartSLOduration=1.469617771 podStartE2EDuration="1.469617771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:42.467527735 +0000 UTC m=+422.649050955" watchObservedRunningTime="2026-07-20 19:07:42.469617771 +0000 UTC m=+422.651140962"
Jul 20 19:07:42.469858 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.469743    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588\": container with ID starting with ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588 not found: ID does not exist" containerID="ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588"
Jul 20 19:07:42.469858 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.469792    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588"} err="failed to get container status \"ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588\": rpc error: code = NotFound desc = could not find container \"ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588\": container with ID starting with ba6082984fff11cf529c3312165fd1db594bc3014b7bddf6f25642af7ad56588 not found: ID does not exist"
Jul 20 19:07:42.470041 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:07:42.470023    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-l9j2j\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="a7f9f1c5-8776-437e-ad42-6c2fec5806e9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-l9j2j"
Jul 20 19:07:42.490839 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:42.490805    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7" podStartSLOduration=1.4907948580000001 podStartE2EDuration="1.490794858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:42.490196551 +0000 UTC m=+422.671719742" watchObservedRunningTime="2026-07-20 19:07:42.490794858 +0000 UTC m=+422.672318048"
Jul 20 19:07:53.457533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.457496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:07:53.729699 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.729622    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:07:53.737464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.737442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.745922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.745899    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:07:53.775939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.775909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx4j\" (UniqueName: \"kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.776052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.775994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.876562 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.876521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxx4j\" (UniqueName: \"kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.876685 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.876619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.876972 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.876955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:53.885976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:53.885958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxx4j\" (UniqueName: \"kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j\") pod \"kuadrant-operator-controller-manager-86878c769f-dzw9w\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:54.049060 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.049034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:54.186645 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.186621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:07:54.188916 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:07:54.188876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136dcaff_5da6_49f6_9a78_6d32aba9c127.slice/crio-692b859b8a0ecca7b56b3ec13fde9edbdec423052db0fa51b372a133139bc25a WatchSource:0}: Error finding container 692b859b8a0ecca7b56b3ec13fde9edbdec423052db0fa51b372a133139bc25a: Status 404 returned error can't find the container with id 692b859b8a0ecca7b56b3ec13fde9edbdec423052db0fa51b372a133139bc25a
Jul 20 19:07:54.462025 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.461947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zdcr7"
Jul 20 19:07:54.514245 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.514210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" event={"ID":"136dcaff-5da6-49f6-9a78-6d32aba9c127","Type":"ContainerStarted","Data":"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"}
Jul 20 19:07:54.514409 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.514269    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" event={"ID":"136dcaff-5da6-49f6-9a78-6d32aba9c127","Type":"ContainerStarted","Data":"692b859b8a0ecca7b56b3ec13fde9edbdec423052db0fa51b372a133139bc25a"}
Jul 20 19:07:54.514409 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.514323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:07:54.534804 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:07:54.534742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" podStartSLOduration=1.534728702 podStartE2EDuration="1.534728702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:07:54.534161626 +0000 UTC m=+434.715684851" watchObservedRunningTime="2026-07-20 19:07:54.534728702 +0000 UTC m=+434.716251891"
Jul 20 19:08:05.522422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.522345    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:08:05.577417 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.577382    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:08:05.577674 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.577645    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" podUID="b2f25050-5e2d-4a19-9344-2c40735b94c6" containerName="manager" containerID="cri-o://7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3" gracePeriod=10
Jul 20 19:08:05.841229 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.841207    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:08:05.979736 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.979705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume\") pod \"b2f25050-5e2d-4a19-9344-2c40735b94c6\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") "
Jul 20 19:08:05.979903 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.979742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dl2l\" (UniqueName: \"kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l\") pod \"b2f25050-5e2d-4a19-9344-2c40735b94c6\" (UID: \"b2f25050-5e2d-4a19-9344-2c40735b94c6\") "
Jul 20 19:08:05.980044 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.980022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2f25050-5e2d-4a19-9344-2c40735b94c6" (UID: "b2f25050-5e2d-4a19-9344-2c40735b94c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:08:05.981850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:05.981831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l" (OuterVolumeSpecName: "kube-api-access-7dl2l") pod "b2f25050-5e2d-4a19-9344-2c40735b94c6" (UID: "b2f25050-5e2d-4a19-9344-2c40735b94c6"). InnerVolumeSpecName "kube-api-access-7dl2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:06.081021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.080968    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2f25050-5e2d-4a19-9344-2c40735b94c6-extensions-socket-volume\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:06.081021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.080988    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dl2l\" (UniqueName: \"kubernetes.io/projected/b2f25050-5e2d-4a19-9344-2c40735b94c6-kube-api-access-7dl2l\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:06.579457 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.579427    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2f25050-5e2d-4a19-9344-2c40735b94c6" containerID="7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3" exitCode=0
Jul 20 19:08:06.579892 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.579470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"
Jul 20 19:08:06.579892 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.579516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" event={"ID":"b2f25050-5e2d-4a19-9344-2c40735b94c6","Type":"ContainerDied","Data":"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"}
Jul 20 19:08:06.579892 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.579565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng" event={"ID":"b2f25050-5e2d-4a19-9344-2c40735b94c6","Type":"ContainerDied","Data":"6efeaa1ee296663495392776f600f707fc6dd0c4bafaa1b58d54c09fefad5d4c"}
Jul 20 19:08:06.579892 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.579589    2563 scope.go:117] "RemoveContainer" containerID="7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"
Jul 20 19:08:06.588642 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.588621    2563 scope.go:117] "RemoveContainer" containerID="7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"
Jul 20 19:08:06.588902 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:08:06.588883    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3\": container with ID starting with 7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3 not found: ID does not exist" containerID="7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"
Jul 20 19:08:06.588965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.588909    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3"} err="failed to get container status \"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3\": rpc error: code = NotFound desc = could not find container \"7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3\": container with ID starting with 7233c201acffd39a0dfd4781395c100d431267520bb254c5a4cf4389c7bdbfa3 not found: ID does not exist"
Jul 20 19:08:06.609340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.609315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:08:06.625018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:06.623922    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j65ng"]
Jul 20 19:08:08.428143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:08.428109    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f25050-5e2d-4a19-9344-2c40735b94c6" path="/var/lib/kubelet/pods/b2f25050-5e2d-4a19-9344-2c40735b94c6/volumes"
Jul 20 19:08:09.993689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.993656    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"]
Jul 20 19:08:09.994093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.994076    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f25050-5e2d-4a19-9344-2c40735b94c6" containerName="manager"
Jul 20 19:08:09.994183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.994097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f25050-5e2d-4a19-9344-2c40735b94c6" containerName="manager"
Jul 20 19:08:09.994183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.994177    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f25050-5e2d-4a19-9344-2c40735b94c6" containerName="manager"
Jul 20 19:08:09.996858 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.996841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:09.999472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:09.999450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-49scn\""
Jul 20 19:08:10.011004 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.010981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"]
Jul 20 19:08:10.109716 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.109867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.109867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.109867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.109867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.109867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.110039 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.110039 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms9c5\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-kube-api-access-ms9c5\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.110039 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.109943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210373 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210506 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210506 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms9c5\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-kube-api-access-ms9c5\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210795 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210795 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210795 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.210965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.210800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.211316 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.211070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.211316 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.211167    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.211456 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.211338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.211506 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.211458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.213604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.213586    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.213746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.213728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.220653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.220632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms9c5\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-kube-api-access-ms9c5\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.220653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.220647    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ceb4421-21dc-41c3-beb1-a52e8b6e57b7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hbn5j\" (UID: \"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.306785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.306720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:10.446785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.446746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"]
Jul 20 19:08:10.448568 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:08:10.448541    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ceb4421_21dc_41c3_beb1_a52e8b6e57b7.slice/crio-2fdb2a0b39503590abee277706830d5f7de82bce427591d0a9cfdf6aa0b0fc46 WatchSource:0}: Error finding container 2fdb2a0b39503590abee277706830d5f7de82bce427591d0a9cfdf6aa0b0fc46: Status 404 returned error can't find the container with id 2fdb2a0b39503590abee277706830d5f7de82bce427591d0a9cfdf6aa0b0fc46
Jul 20 19:08:10.453358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.453324    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:08:10.453454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.453388    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:08:10.453454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.453423    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:08:10.603906 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.603794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" event={"ID":"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7","Type":"ContainerStarted","Data":"b501b431a04dc6632b4dd0c9f1c3f78f578715d50d3673792e875726f1cbb4b9"}
Jul 20 19:08:10.603906 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.603860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" event={"ID":"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7","Type":"ContainerStarted","Data":"2fdb2a0b39503590abee277706830d5f7de82bce427591d0a9cfdf6aa0b0fc46"}
Jul 20 19:08:10.626431 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:10.626373    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" podStartSLOduration=1.626356904 podStartE2EDuration="1.626356904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:10.625263441 +0000 UTC m=+450.806786674" watchObservedRunningTime="2026-07-20 19:08:10.626356904 +0000 UTC m=+450.807880093"
Jul 20 19:08:11.306896 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:11.306869    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:11.312178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:11.312152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:11.609717 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:11.609636    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:11.610730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:11.610709    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:08:26.051541 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.051510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:26.054523 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.054496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:26.057162 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.057145    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wk7z6\""
Jul 20 19:08:26.064996 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.064972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:26.231324 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.231294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvbz\" (UniqueName: \"kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz\") pod \"authorino-58cd955675-rhtfc\" (UID: \"566e8c90-6cad-4fc5-87a4-f2434b2390c8\") " pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:26.264770 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.264734    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:26.266991 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.266974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:26.275660 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.275640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:26.331722 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.331672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvbz\" (UniqueName: \"kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz\") pod \"authorino-58cd955675-rhtfc\" (UID: \"566e8c90-6cad-4fc5-87a4-f2434b2390c8\") " pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:26.339943 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.339919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvbz\" (UniqueName: \"kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz\") pod \"authorino-58cd955675-rhtfc\" (UID: \"566e8c90-6cad-4fc5-87a4-f2434b2390c8\") " pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:26.365845 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.365823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:26.432971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.432943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn8dr\" (UniqueName: \"kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr\") pod \"authorino-75d556bd77-n82nj\" (UID: \"753700d0-280e-4f45-8a13-bb2aa3c2039c\") " pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:26.492867 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.492841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:26.494456 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:08:26.494431    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod566e8c90_6cad_4fc5_87a4_f2434b2390c8.slice/crio-07859ef5052799234ea2518fc33d969b631ecda89bcdbc97e845e459c6f870c9 WatchSource:0}: Error finding container 07859ef5052799234ea2518fc33d969b631ecda89bcdbc97e845e459c6f870c9: Status 404 returned error can't find the container with id 07859ef5052799234ea2518fc33d969b631ecda89bcdbc97e845e459c6f870c9
Jul 20 19:08:26.533440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.533414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn8dr\" (UniqueName: \"kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr\") pod \"authorino-75d556bd77-n82nj\" (UID: \"753700d0-280e-4f45-8a13-bb2aa3c2039c\") " pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:26.542596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.542571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn8dr\" (UniqueName: \"kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr\") pod \"authorino-75d556bd77-n82nj\" (UID: \"753700d0-280e-4f45-8a13-bb2aa3c2039c\") " pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:26.576940 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.576918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:26.690245 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.690211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhtfc" event={"ID":"566e8c90-6cad-4fc5-87a4-f2434b2390c8","Type":"ContainerStarted","Data":"07859ef5052799234ea2518fc33d969b631ecda89bcdbc97e845e459c6f870c9"}
Jul 20 19:08:26.706254 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:26.706230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:26.706577 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:08:26.706556    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod753700d0_280e_4f45_8a13_bb2aa3c2039c.slice/crio-4047329a27825a187ea0d719d7bb35e645aedf791e64c6a99b3b411abfdea3e3 WatchSource:0}: Error finding container 4047329a27825a187ea0d719d7bb35e645aedf791e64c6a99b3b411abfdea3e3: Status 404 returned error can't find the container with id 4047329a27825a187ea0d719d7bb35e645aedf791e64c6a99b3b411abfdea3e3
Jul 20 19:08:27.699120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:27.699081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n82nj" event={"ID":"753700d0-280e-4f45-8a13-bb2aa3c2039c","Type":"ContainerStarted","Data":"4047329a27825a187ea0d719d7bb35e645aedf791e64c6a99b3b411abfdea3e3"}
Jul 20 19:08:30.719167 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:30.719125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhtfc" event={"ID":"566e8c90-6cad-4fc5-87a4-f2434b2390c8","Type":"ContainerStarted","Data":"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"}
Jul 20 19:08:30.720533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:30.720509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n82nj" event={"ID":"753700d0-280e-4f45-8a13-bb2aa3c2039c","Type":"ContainerStarted","Data":"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"}
Jul 20 19:08:30.736627 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:30.736574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rhtfc" podStartSLOduration=1.086554634 podStartE2EDuration="4.736562523s" totalImagesPullingTime="3.650007889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:30.733910213 +0000 UTC m=+470.915433422" watchObservedRunningTime="2026-07-20 19:08:30.736562523 +0000 UTC m=+470.918085752"
Jul 20 19:08:30.751348 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:30.751300    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n82nj" podStartSLOduration=1.307611924 podStartE2EDuration="4.751286928s" totalImagesPullingTime="3.443675004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:30.749019726 +0000 UTC m=+470.930542915" watchObservedRunningTime="2026-07-20 19:08:30.751286928 +0000 UTC m=+470.932810118"
Jul 20 19:08:30.777605 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:30.777574    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:32.730559 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:32.730521    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rhtfc" podUID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" containerName="authorino" containerID="cri-o://d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2" gracePeriod=30
Jul 20 19:08:32.979298 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:32.979276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:33.092514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.092480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqvbz\" (UniqueName: \"kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz\") pod \"566e8c90-6cad-4fc5-87a4-f2434b2390c8\" (UID: \"566e8c90-6cad-4fc5-87a4-f2434b2390c8\") "
Jul 20 19:08:33.094456 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.094433    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz" (OuterVolumeSpecName: "kube-api-access-bqvbz") pod "566e8c90-6cad-4fc5-87a4-f2434b2390c8" (UID: "566e8c90-6cad-4fc5-87a4-f2434b2390c8"). InnerVolumeSpecName "kube-api-access-bqvbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:33.193339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.193303    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqvbz\" (UniqueName: \"kubernetes.io/projected/566e8c90-6cad-4fc5-87a4-f2434b2390c8-kube-api-access-bqvbz\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:33.737489 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.737456    2563 generic.go:356] "Generic (PLEG): container finished" podID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" containerID="d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2" exitCode=0
Jul 20 19:08:33.737873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.737493    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rhtfc"
Jul 20 19:08:33.737873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.737504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhtfc" event={"ID":"566e8c90-6cad-4fc5-87a4-f2434b2390c8","Type":"ContainerDied","Data":"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"}
Jul 20 19:08:33.737873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.737535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rhtfc" event={"ID":"566e8c90-6cad-4fc5-87a4-f2434b2390c8","Type":"ContainerDied","Data":"07859ef5052799234ea2518fc33d969b631ecda89bcdbc97e845e459c6f870c9"}
Jul 20 19:08:33.737873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.737551    2563 scope.go:117] "RemoveContainer" containerID="d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"
Jul 20 19:08:33.746421 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.746405    2563 scope.go:117] "RemoveContainer" containerID="d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"
Jul 20 19:08:33.746666 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:08:33.746649    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2\": container with ID starting with d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2 not found: ID does not exist" containerID="d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"
Jul 20 19:08:33.746733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.746672    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2"} err="failed to get container status \"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2\": rpc error: code = NotFound desc = could not find container \"d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2\": container with ID starting with d00b34635729cb5141e3eaf274f613eb78a8886e5ba290d0a8d70a14a7a16bf2 not found: ID does not exist"
Jul 20 19:08:33.760399 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.759803    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:33.766191 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:33.766095    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rhtfc"]
Jul 20 19:08:34.427349 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:34.427314    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" path="/var/lib/kubelet/pods/566e8c90-6cad-4fc5-87a4-f2434b2390c8/volumes"
Jul 20 19:08:56.559208 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.559172    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87ww7"]
Jul 20 19:08:56.559602 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.559585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" containerName="authorino"
Jul 20 19:08:56.559647 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.559604    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" containerName="authorino"
Jul 20 19:08:56.559678 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.559663    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="566e8c90-6cad-4fc5-87a4-f2434b2390c8" containerName="authorino"
Jul 20 19:08:56.562527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.562508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.569844 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.569822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87ww7"]
Jul 20 19:08:56.668336 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.668312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnzjs\" (UniqueName: \"kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs\") pod \"authorino-5d4b67c446-87ww7\" (UID: \"7a072852-f258-46ed-b701-ade7a61d4ec7\") " pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.768954 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.768928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnzjs\" (UniqueName: \"kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs\") pod \"authorino-5d4b67c446-87ww7\" (UID: \"7a072852-f258-46ed-b701-ade7a61d4ec7\") " pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.777408 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.777385    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87ww7"]
Jul 20 19:08:56.777602 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:08:56.777580    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lnzjs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-87ww7" podUID="7a072852-f258-46ed-b701-ade7a61d4ec7"
Jul 20 19:08:56.782111 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.782092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnzjs\" (UniqueName: \"kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs\") pod \"authorino-5d4b67c446-87ww7\" (UID: \"7a072852-f258-46ed-b701-ade7a61d4ec7\") " pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.802842 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.802813    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-kg97z"]
Jul 20 19:08:56.806022 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.805997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.808988 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.808966    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 19:08:56.813696 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.813679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-kg97z"]
Jul 20 19:08:56.857315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.857294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.863071 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.863050    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-kg97z"]
Jul 20 19:08:56.863251 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:08:56.863236    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wr4dz tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-kg97z" podUID="2c2e4975-568b-4313-9c7c-72d363df9fda"
Jul 20 19:08:56.863893 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.863877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:56.870088 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.869932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr4dz\" (UniqueName: \"kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.875535 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.870371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.900816 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.900778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:08:56.904033 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.904016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:56.912557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.912534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:08:56.970955 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.970933    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnzjs\" (UniqueName: \"kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs\") pod \"7a072852-f258-46ed-b701-ade7a61d4ec7\" (UID: \"7a072852-f258-46ed-b701-ade7a61d4ec7\") "
Jul 20 19:08:56.971083 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.971064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr4dz\" (UniqueName: \"kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.971139 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.971110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.971194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.971143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45s2v\" (UniqueName: \"kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:56.971194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.971190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:56.973079 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.973052    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs" (OuterVolumeSpecName: "kube-api-access-lnzjs") pod "7a072852-f258-46ed-b701-ade7a61d4ec7" (UID: "7a072852-f258-46ed-b701-ade7a61d4ec7"). InnerVolumeSpecName "kube-api-access-lnzjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:56.973425 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.973406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:56.980839 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:56.980821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr4dz\" (UniqueName: \"kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz\") pod \"authorino-76877994-kg97z\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") " pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:57.071928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.071884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45s2v\" (UniqueName: \"kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:57.071928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.071918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:57.072082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.071963    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnzjs\" (UniqueName: \"kubernetes.io/projected/7a072852-f258-46ed-b701-ade7a61d4ec7-kube-api-access-lnzjs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:57.073892 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.073873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:57.081120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.081102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45s2v\" (UniqueName: \"kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v\") pod \"authorino-848946859-7dvt9\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") " pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:57.212687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.212659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:08:57.343026 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.342995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:08:57.344828 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:08:57.344804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode10952cc_fe0b_4b3b_a62c_317c784cb671.slice/crio-7aef49e33ada356bc593bbcf29929e0764a9f7bfd066e660f7ba849bf0408ec0 WatchSource:0}: Error finding container 7aef49e33ada356bc593bbcf29929e0764a9f7bfd066e660f7ba849bf0408ec0: Status 404 returned error can't find the container with id 7aef49e33ada356bc593bbcf29929e0764a9f7bfd066e660f7ba849bf0408ec0
Jul 20 19:08:57.866020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.865988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848946859-7dvt9" event={"ID":"e10952cc-fe0b-4b3b-a62c-317c784cb671","Type":"ContainerStarted","Data":"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"}
Jul 20 19:08:57.866020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.866015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-87ww7"
Jul 20 19:08:57.866431 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.866036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:57.866431 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.866039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848946859-7dvt9" event={"ID":"e10952cc-fe0b-4b3b-a62c-317c784cb671","Type":"ContainerStarted","Data":"7aef49e33ada356bc593bbcf29929e0764a9f7bfd066e660f7ba849bf0408ec0"}
Jul 20 19:08:57.873007 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.872989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:57.913192 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.912634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-848946859-7dvt9" podStartSLOduration=1.492868188 podStartE2EDuration="1.912616829s" totalImagesPullingTime="419.748641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:57.896060196 +0000 UTC m=+498.077583417" watchObservedRunningTime="2026-07-20 19:08:57.912616829 +0000 UTC m=+498.094140001"
Jul 20 19:08:57.925422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.925398    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:57.925574 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.925546    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n82nj" podUID="753700d0-280e-4f45-8a13-bb2aa3c2039c" containerName="authorino" containerID="cri-o://3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1" gracePeriod=30
Jul 20 19:08:57.951254 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.951230    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87ww7"]
Jul 20 19:08:57.958518 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.958490    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-87ww7"]
Jul 20 19:08:57.979446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.979425    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert\") pod \"2c2e4975-568b-4313-9c7c-72d363df9fda\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") "
Jul 20 19:08:57.979541 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.979527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr4dz\" (UniqueName: \"kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz\") pod \"2c2e4975-568b-4313-9c7c-72d363df9fda\" (UID: \"2c2e4975-568b-4313-9c7c-72d363df9fda\") "
Jul 20 19:08:57.981543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.981520    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2c2e4975-568b-4313-9c7c-72d363df9fda" (UID: "2c2e4975-568b-4313-9c7c-72d363df9fda"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:08:57.981636 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:57.981600    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz" (OuterVolumeSpecName: "kube-api-access-wr4dz") pod "2c2e4975-568b-4313-9c7c-72d363df9fda" (UID: "2c2e4975-568b-4313-9c7c-72d363df9fda"). InnerVolumeSpecName "kube-api-access-wr4dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:58.081174 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.081148    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr4dz\" (UniqueName: \"kubernetes.io/projected/2c2e4975-568b-4313-9c7c-72d363df9fda-kube-api-access-wr4dz\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:58.081174 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.081175    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2c2e4975-568b-4313-9c7c-72d363df9fda-tls-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:58.165023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.164988    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:58.181544 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.181521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn8dr\" (UniqueName: \"kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr\") pod \"753700d0-280e-4f45-8a13-bb2aa3c2039c\" (UID: \"753700d0-280e-4f45-8a13-bb2aa3c2039c\") "
Jul 20 19:08:58.183675 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.183648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr" (OuterVolumeSpecName: "kube-api-access-vn8dr") pod "753700d0-280e-4f45-8a13-bb2aa3c2039c" (UID: "753700d0-280e-4f45-8a13-bb2aa3c2039c"). InnerVolumeSpecName "kube-api-access-vn8dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:08:58.282904 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.282882    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn8dr\" (UniqueName: \"kubernetes.io/projected/753700d0-280e-4f45-8a13-bb2aa3c2039c-kube-api-access-vn8dr\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:08:58.428027 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.427968    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a072852-f258-46ed-b701-ade7a61d4ec7" path="/var/lib/kubelet/pods/7a072852-f258-46ed-b701-ade7a61d4ec7/volumes"
Jul 20 19:08:58.872588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872561    2563 generic.go:356] "Generic (PLEG): container finished" podID="753700d0-280e-4f45-8a13-bb2aa3c2039c" containerID="3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1" exitCode=0
Jul 20 19:08:58.872999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872607    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n82nj"
Jul 20 19:08:58.872999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n82nj" event={"ID":"753700d0-280e-4f45-8a13-bb2aa3c2039c","Type":"ContainerDied","Data":"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"}
Jul 20 19:08:58.872999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n82nj" event={"ID":"753700d0-280e-4f45-8a13-bb2aa3c2039c","Type":"ContainerDied","Data":"4047329a27825a187ea0d719d7bb35e645aedf791e64c6a99b3b411abfdea3e3"}
Jul 20 19:08:58.872999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872711    2563 scope.go:117] "RemoveContainer" containerID="3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"
Jul 20 19:08:58.872999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.872733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-kg97z"
Jul 20 19:08:58.881476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.881457    2563 scope.go:117] "RemoveContainer" containerID="3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"
Jul 20 19:08:58.881694 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:08:58.881675    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1\": container with ID starting with 3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1 not found: ID does not exist" containerID="3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"
Jul 20 19:08:58.881772 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.881700    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1"} err="failed to get container status \"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1\": rpc error: code = NotFound desc = could not find container \"3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1\": container with ID starting with 3edeee14f8f98a0d693987f4923d78c472a6d8a13a35b91461e0bbbbd006c9e1 not found: ID does not exist"
Jul 20 19:08:58.895679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.895659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:58.900249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.900231    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n82nj"]
Jul 20 19:08:58.922522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.922502    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-kg97z"]
Jul 20 19:08:58.924988 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:08:58.924970    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-kg97z"]
Jul 20 19:09:00.428407 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:00.428363    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c2e4975-568b-4313-9c7c-72d363df9fda" path="/var/lib/kubelet/pods/2c2e4975-568b-4313-9c7c-72d363df9fda/volumes"
Jul 20 19:09:00.428898 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:00.428704    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753700d0-280e-4f45-8a13-bb2aa3c2039c" path="/var/lib/kubelet/pods/753700d0-280e-4f45-8a13-bb2aa3c2039c/volumes"
Jul 20 19:09:39.533927 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.533891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8krcx"]
Jul 20 19:09:39.534713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.534277    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753700d0-280e-4f45-8a13-bb2aa3c2039c" containerName="authorino"
Jul 20 19:09:39.534713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.534290    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="753700d0-280e-4f45-8a13-bb2aa3c2039c" containerName="authorino"
Jul 20 19:09:39.534713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.534355    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="753700d0-280e-4f45-8a13-bb2aa3c2039c" containerName="authorino"
Jul 20 19:09:39.536308 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.536292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.539176 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.539152    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 19:09:39.539295 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.539270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mz7xd\""
Jul 20 19:09:39.548053 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.548032    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8krcx"]
Jul 20 19:09:39.700143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.700112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr76c\" (UniqueName: \"kubernetes.io/projected/a9fcdd8b-0534-4f90-b984-959e267d2b06-kube-api-access-xr76c\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.700310 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.700168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9fcdd8b-0534-4f90-b984-959e267d2b06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.801175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.801099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr76c\" (UniqueName: \"kubernetes.io/projected/a9fcdd8b-0534-4f90-b984-959e267d2b06-kube-api-access-xr76c\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.801175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.801161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9fcdd8b-0534-4f90-b984-959e267d2b06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.801873 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.801853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9fcdd8b-0534-4f90-b984-959e267d2b06-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.810799 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.810775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr76c\" (UniqueName: \"kubernetes.io/projected/a9fcdd8b-0534-4f90-b984-959e267d2b06-kube-api-access-xr76c\") pod \"payload-pre-processing-7677b774bb-8krcx\" (UID: \"a9fcdd8b-0534-4f90-b984-959e267d2b06\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:39.847735 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:39.847694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:40.206420 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:40.206380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8krcx"]
Jul 20 19:09:40.207655 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:09:40.207630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fcdd8b_0534_4f90_b984_959e267d2b06.slice/crio-1d390b99112bfdfa88d4c170b7e760879f4b15973df48b2aeb10ef9bf4e5fbcf WatchSource:0}: Error finding container 1d390b99112bfdfa88d4c170b7e760879f4b15973df48b2aeb10ef9bf4e5fbcf: Status 404 returned error can't find the container with id 1d390b99112bfdfa88d4c170b7e760879f4b15973df48b2aeb10ef9bf4e5fbcf
Jul 20 19:09:41.114447 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:41.114407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx" event={"ID":"a9fcdd8b-0534-4f90-b984-959e267d2b06","Type":"ContainerStarted","Data":"1d390b99112bfdfa88d4c170b7e760879f4b15973df48b2aeb10ef9bf4e5fbcf"}
Jul 20 19:09:42.121050 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:42.121016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx" event={"ID":"a9fcdd8b-0534-4f90-b984-959e267d2b06","Type":"ContainerStarted","Data":"b2c2c656fc993d3ce4810a0706bcc9dfc765f9f4f0cb64dba9682d024f77f64c"}
Jul 20 19:09:42.121464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:42.121141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:09:42.140558 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:42.140501    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx" podStartSLOduration=1.371019539 podStartE2EDuration="3.140487435s" totalImagesPullingTime="1.769467896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:09:42.138948263 +0000 UTC m=+542.320471474" watchObservedRunningTime="2026-07-20 19:09:42.140487435 +0000 UTC m=+542.322010661"
Jul 20 19:09:47.151813 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.151723    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ceb4421-21dc-41c3-beb1-a52e8b6e57b7" containerID="b501b431a04dc6632b4dd0c9f1c3f78f578715d50d3673792e875726f1cbb4b9" exitCode=0
Jul 20 19:09:47.152197 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.151802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" event={"ID":"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7","Type":"ContainerDied","Data":"b501b431a04dc6632b4dd0c9f1c3f78f578715d50d3673792e875726f1cbb4b9"}
Jul 20 19:09:47.152252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.152196    2563 scope.go:117] "RemoveContainer" containerID="b501b431a04dc6632b4dd0c9f1c3f78f578715d50d3673792e875726f1cbb4b9"
Jul 20 19:09:47.153272 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.153244    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:09:47.153331 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.153322    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:09:47.153391 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:47.153377    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:09:48.169881 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:48.169847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" event={"ID":"5ceb4421-21dc-41c3-beb1-a52e8b6e57b7","Type":"ContainerStarted","Data":"43750977c94ab80f9c8a4da1cb3e3e15ccf20aa9d3d6c1695f47c904bb56cda0"}
Jul 20 19:09:48.307189 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:48.307150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:09:48.307387 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:48.307366    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hbn5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 20 19:09:48.307438 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:48.307415    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" podUID="5ceb4421-21dc-41c3-beb1-a52e8b6e57b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 20 19:09:49.307574 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:49.307535    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hbn5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 20 19:09:49.307971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:49.307591    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" podUID="5ceb4421-21dc-41c3-beb1-a52e8b6e57b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 20 19:09:50.307381 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:50.307346    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hbn5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 20 19:09:50.307598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:50.307408    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" podUID="5ceb4421-21dc-41c3-beb1-a52e8b6e57b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 20 19:09:51.307741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:51.307706    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hbn5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 20 19:09:51.308145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:51.307788    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j" podUID="5ceb4421-21dc-41c3-beb1-a52e8b6e57b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 20 19:09:52.311032 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:52.311001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:09:52.311493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:52.311282    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:09:52.312002 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:52.311979    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hbn5j"
Jul 20 19:09:53.129550 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:09:53.129519    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8krcx"
Jul 20 19:10:36.825073 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.825039    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"]
Jul 20 19:10:36.828527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.828505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.831410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.831390    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 19:10:36.832703 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.832681    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 19:10:36.832832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.832715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 19:10:36.832832 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.832808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-87hgb\""
Jul 20 19:10:36.840091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.840069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"]
Jul 20 19:10:36.923266 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcwvk\" (UniqueName: \"kubernetes.io/projected/16c6a5b3-f61e-4720-9d60-6cf82656a389-kube-api-access-dcwvk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.923372 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.923372 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.923372 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c6a5b3-f61e-4720-9d60-6cf82656a389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.923477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:36.923477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:36.923429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024246 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024387 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024387 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcwvk\" (UniqueName: \"kubernetes.io/projected/16c6a5b3-f61e-4720-9d60-6cf82656a389-kube-api-access-dcwvk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024387 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c6a5b3-f61e-4720-9d60-6cf82656a389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024745 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.024961 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.024935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.026641 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.026615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16c6a5b3-f61e-4720-9d60-6cf82656a389-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.026849 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.026833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16c6a5b3-f61e-4720-9d60-6cf82656a389-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.034052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.034030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcwvk\" (UniqueName: \"kubernetes.io/projected/16c6a5b3-f61e-4720-9d60-6cf82656a389-kube-api-access-dcwvk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gfssk\" (UID: \"16c6a5b3-f61e-4720-9d60-6cf82656a389\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.139182 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.139125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:37.292987 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.292873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"]
Jul 20 19:10:37.296086 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:10:37.296061    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c6a5b3_f61e_4720_9d60_6cf82656a389.slice/crio-3f50c6c62b9accedd1102f25d6cab7f6fd51a1c8171fcd681b725d29867659ea WatchSource:0}: Error finding container 3f50c6c62b9accedd1102f25d6cab7f6fd51a1c8171fcd681b725d29867659ea: Status 404 returned error can't find the container with id 3f50c6c62b9accedd1102f25d6cab7f6fd51a1c8171fcd681b725d29867659ea
Jul 20 19:10:37.443291 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:37.443215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk" event={"ID":"16c6a5b3-f61e-4720-9d60-6cf82656a389","Type":"ContainerStarted","Data":"3f50c6c62b9accedd1102f25d6cab7f6fd51a1c8171fcd681b725d29867659ea"}
Jul 20 19:10:39.457998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:39.457962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk" event={"ID":"16c6a5b3-f61e-4720-9d60-6cf82656a389","Type":"ContainerStarted","Data":"a1d603baef594a2f4ab43bd6a06a48a77d8987f72102cf4f94053f27bbe95c21"}
Jul 20 19:10:40.280514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:40.280480    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:10:40.280957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:40.280935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:10:47.139509 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:47.139471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:47.140005 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:47.139548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:47.152564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:47.152538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:10:47.179422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:47.179375    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk" podStartSLOduration=9.838950288 podStartE2EDuration="11.179362761s" totalImagesPullingTime="1.340412473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:10:39.497375086 +0000 UTC m=+599.678898280" watchObservedRunningTime="2026-07-20 19:10:47.179362761 +0000 UTC m=+607.360885949"
Jul 20 19:10:47.510402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:10:47.510378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gfssk"
Jul 20 19:11:57.966348 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:57.966317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cdcb58dd6-4xxvd"]
Jul 20 19:11:57.969803 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:57.969783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:57.978742 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:57.978718    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cdcb58dd6-4xxvd"]
Jul 20 19:11:58.057403 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.057374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6d40cf6-849b-4f96-8915-42b4b6e14b53-tls-cert\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.057513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.057428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28qt9\" (UniqueName: \"kubernetes.io/projected/e6d40cf6-849b-4f96-8915-42b4b6e14b53-kube-api-access-28qt9\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.158490 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.158466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6d40cf6-849b-4f96-8915-42b4b6e14b53-tls-cert\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.158609 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.158517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28qt9\" (UniqueName: \"kubernetes.io/projected/e6d40cf6-849b-4f96-8915-42b4b6e14b53-kube-api-access-28qt9\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.161047 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.161015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e6d40cf6-849b-4f96-8915-42b4b6e14b53-tls-cert\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.167578 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.167557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28qt9\" (UniqueName: \"kubernetes.io/projected/e6d40cf6-849b-4f96-8915-42b4b6e14b53-kube-api-access-28qt9\") pod \"authorino-6cdcb58dd6-4xxvd\" (UID: \"e6d40cf6-849b-4f96-8915-42b4b6e14b53\") " pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.279825 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.279797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd"
Jul 20 19:11:58.405856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.405833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cdcb58dd6-4xxvd"]
Jul 20 19:11:58.407096 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:11:58.407073    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6d40cf6_849b_4f96_8915_42b4b6e14b53.slice/crio-0499d0d0da97a885e26eca2f12cc14658874812514cf86178b6674cf2adaab03 WatchSource:0}: Error finding container 0499d0d0da97a885e26eca2f12cc14658874812514cf86178b6674cf2adaab03: Status 404 returned error can't find the container with id 0499d0d0da97a885e26eca2f12cc14658874812514cf86178b6674cf2adaab03
Jul 20 19:11:58.408317 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.408300    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:11:58.881084 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:58.881051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd" event={"ID":"e6d40cf6-849b-4f96-8915-42b4b6e14b53","Type":"ContainerStarted","Data":"0499d0d0da97a885e26eca2f12cc14658874812514cf86178b6674cf2adaab03"}
Jul 20 19:11:59.890771 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:59.890724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd" event={"ID":"e6d40cf6-849b-4f96-8915-42b4b6e14b53","Type":"ContainerStarted","Data":"1b5bebacd2e79d1ee497eca114f368ea3acb0e534b48184038fa670670a031c1"}
Jul 20 19:11:59.920710 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:59.920617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cdcb58dd6-4xxvd" podStartSLOduration=2.436812818 podStartE2EDuration="2.920596401s" totalImagesPullingTime="483.783583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:11:59.916666147 +0000 UTC m=+680.098189351" watchObservedRunningTime="2026-07-20 19:11:59.920596401 +0000 UTC m=+680.102119589"
Jul 20 19:11:59.974006 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:59.973971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:11:59.974191 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:11:59.974161    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-848946859-7dvt9" podUID="e10952cc-fe0b-4b3b-a62c-317c784cb671" containerName="authorino" containerID="cri-o://50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a" gracePeriod=30
Jul 20 19:12:00.250123 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.250095    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:12:00.382650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.382615    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45s2v\" (UniqueName: \"kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v\") pod \"e10952cc-fe0b-4b3b-a62c-317c784cb671\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") "
Jul 20 19:12:00.382859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.382687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert\") pod \"e10952cc-fe0b-4b3b-a62c-317c784cb671\" (UID: \"e10952cc-fe0b-4b3b-a62c-317c784cb671\") "
Jul 20 19:12:00.384808 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.384780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v" (OuterVolumeSpecName: "kube-api-access-45s2v") pod "e10952cc-fe0b-4b3b-a62c-317c784cb671" (UID: "e10952cc-fe0b-4b3b-a62c-317c784cb671"). InnerVolumeSpecName "kube-api-access-45s2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:12:00.393656 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.393636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e10952cc-fe0b-4b3b-a62c-317c784cb671" (UID: "e10952cc-fe0b-4b3b-a62c-317c784cb671"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:12:00.484194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.484159    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45s2v\" (UniqueName: \"kubernetes.io/projected/e10952cc-fe0b-4b3b-a62c-317c784cb671-kube-api-access-45s2v\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:12:00.484194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.484195    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e10952cc-fe0b-4b3b-a62c-317c784cb671-tls-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:12:00.902927 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.902892    2563 generic.go:356] "Generic (PLEG): container finished" podID="e10952cc-fe0b-4b3b-a62c-317c784cb671" containerID="50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a" exitCode=0
Jul 20 19:12:00.903393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.902954    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848946859-7dvt9"
Jul 20 19:12:00.903393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.902975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848946859-7dvt9" event={"ID":"e10952cc-fe0b-4b3b-a62c-317c784cb671","Type":"ContainerDied","Data":"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"}
Jul 20 19:12:00.903393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.903019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848946859-7dvt9" event={"ID":"e10952cc-fe0b-4b3b-a62c-317c784cb671","Type":"ContainerDied","Data":"7aef49e33ada356bc593bbcf29929e0764a9f7bfd066e660f7ba849bf0408ec0"}
Jul 20 19:12:00.903393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.903040    2563 scope.go:117] "RemoveContainer" containerID="50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"
Jul 20 19:12:00.912522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.912508    2563 scope.go:117] "RemoveContainer" containerID="50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"
Jul 20 19:12:00.912801 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:12:00.912780    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a\": container with ID starting with 50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a not found: ID does not exist" containerID="50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"
Jul 20 19:12:00.912894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.912808    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a"} err="failed to get container status \"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a\": rpc error: code = NotFound desc = could not find container \"50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a\": container with ID starting with 50fb08c0fe29489f6a782f5104d191716445595649646dd3a9a2e9ab60b0cf3a not found: ID does not exist"
Jul 20 19:12:00.925211 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.925180    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:12:00.928320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:00.928293    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-848946859-7dvt9"]
Jul 20 19:12:02.427246 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:12:02.427213    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10952cc-fe0b-4b3b-a62c-317c784cb671" path="/var/lib/kubelet/pods/e10952cc-fe0b-4b3b-a62c-317c784cb671/volumes"
Jul 20 19:14:09.076999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.076923    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55476c59db-lw2dr"]
Jul 20 19:14:09.077440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.077283    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10952cc-fe0b-4b3b-a62c-317c784cb671" containerName="authorino"
Jul 20 19:14:09.077440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.077294    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10952cc-fe0b-4b3b-a62c-317c784cb671" containerName="authorino"
Jul 20 19:14:09.077440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.077355    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10952cc-fe0b-4b3b-a62c-317c784cb671" containerName="authorino"
Jul 20 19:14:09.080356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.080341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.083342 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.083322    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 19:14:09.084557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.084533    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 19:14:09.084663 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.084632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f4nrb\""
Jul 20 19:14:09.090488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.090465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-lw2dr"]
Jul 20 19:14:09.229941 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.229916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a990562a-c5b5-4469-89f6-e8085faf2ce7-webhook-cert\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.230045 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.229947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n2dl\" (UniqueName: \"kubernetes.io/projected/a990562a-c5b5-4469-89f6-e8085faf2ce7-kube-api-access-4n2dl\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.330446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.330392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a990562a-c5b5-4469-89f6-e8085faf2ce7-webhook-cert\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.330446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.330420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n2dl\" (UniqueName: \"kubernetes.io/projected/a990562a-c5b5-4469-89f6-e8085faf2ce7-kube-api-access-4n2dl\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.332767 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.332725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a990562a-c5b5-4469-89f6-e8085faf2ce7-webhook-cert\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.339917 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.339897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n2dl\" (UniqueName: \"kubernetes.io/projected/a990562a-c5b5-4469-89f6-e8085faf2ce7-kube-api-access-4n2dl\") pod \"maas-controller-55476c59db-lw2dr\" (UID: \"a990562a-c5b5-4469-89f6-e8085faf2ce7\") " pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.391835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.391817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:09.523178 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.523154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55476c59db-lw2dr"]
Jul 20 19:14:09.524547 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:14:09.524516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda990562a_c5b5_4469_89f6_e8085faf2ce7.slice/crio-f1eeea79b2b4e4301f6ab0fef4f282bc91beb33af50bc9cae4ce624ce794ee47 WatchSource:0}: Error finding container f1eeea79b2b4e4301f6ab0fef4f282bc91beb33af50bc9cae4ce624ce794ee47: Status 404 returned error can't find the container with id f1eeea79b2b4e4301f6ab0fef4f282bc91beb33af50bc9cae4ce624ce794ee47
Jul 20 19:14:09.589218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:09.589155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-lw2dr" event={"ID":"a990562a-c5b5-4469-89f6-e8085faf2ce7","Type":"ContainerStarted","Data":"f1eeea79b2b4e4301f6ab0fef4f282bc91beb33af50bc9cae4ce624ce794ee47"}
Jul 20 19:14:12.610278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:12.610234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55476c59db-lw2dr" event={"ID":"a990562a-c5b5-4469-89f6-e8085faf2ce7","Type":"ContainerStarted","Data":"fd8e8090918c2181f763fe55e03e6051deec14f12f92359427ccf9d246eec445"}
Jul 20 19:14:12.610649 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:12.610300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:14:12.631253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:12.631203    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55476c59db-lw2dr" podStartSLOduration=1.3726846560000001 podStartE2EDuration="3.631188473s" totalImagesPullingTime="2.258503817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:14:12.628520804 +0000 UTC m=+812.810044006" watchObservedRunningTime="2026-07-20 19:14:12.631188473 +0000 UTC m=+812.812711662"
Jul 20 19:14:23.616839 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:14:23.616800    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55476c59db-lw2dr"
Jul 20 19:15:00.146438 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.146407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"]
Jul 20 19:15:00.149988 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.149973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"
Jul 20 19:15:00.153007 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.152986    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:15:00.158801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.158780    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"]
Jul 20 19:15:00.161067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.161047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"
Jul 20 19:15:00.498343 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.498322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"]
Jul 20 19:15:00.499744 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:15:00.499715    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816ba813_4cd6_49d1_9711_900452f3480c.slice/crio-5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc WatchSource:0}: Error finding container 5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc: Status 404 returned error can't find the container with id 5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc
Jul 20 19:15:00.876267 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:00.876203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x" event={"ID":"816ba813-4cd6-49d1-9711-900452f3480c","Type":"ContainerStarted","Data":"5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc"}
Jul 20 19:15:03.894856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:03.894830    2563 generic.go:356] "Generic (PLEG): container finished" podID="816ba813-4cd6-49d1-9711-900452f3480c" containerID="74f4aa00e0a4629cf7a26da734f9a1f05bb3f6d2a0aab9b29b111b56ccda67d0" exitCode=0
Jul 20 19:15:03.895129 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:03.894906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x" event={"ID":"816ba813-4cd6-49d1-9711-900452f3480c","Type":"ContainerDied","Data":"74f4aa00e0a4629cf7a26da734f9a1f05bb3f6d2a0aab9b29b111b56ccda67d0"}
Jul 20 19:15:05.027904 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:05.027881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"
Jul 20 19:15:05.906132 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:05.906105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x"
Jul 20 19:15:05.906293 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:05.906143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742915-7g55x" event={"ID":"816ba813-4cd6-49d1-9711-900452f3480c","Type":"ContainerDied","Data":"5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc"}
Jul 20 19:15:05.906293 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:05.906185    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5656bc26b708cfd099f2c2facb64f0017b088252331e9ca64449905d66c757dc"
Jul 20 19:15:40.312543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:40.312518    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:15:40.315598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:15:40.315571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:18:53.649383 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:53.649342    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:18:53.649964 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:53.649532    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" podUID="136dcaff-5da6-49f6-9a78-6d32aba9c127" containerName="manager" containerID="cri-o://d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4" gracePeriod=10
Jul 20 19:18:56.507220 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.507198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:18:56.583682 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.583612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxx4j\" (UniqueName: \"kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j\") pod \"136dcaff-5da6-49f6-9a78-6d32aba9c127\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") "
Jul 20 19:18:56.583815 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.583690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume\") pod \"136dcaff-5da6-49f6-9a78-6d32aba9c127\" (UID: \"136dcaff-5da6-49f6-9a78-6d32aba9c127\") "
Jul 20 19:18:56.584021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.584002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "136dcaff-5da6-49f6-9a78-6d32aba9c127" (UID: "136dcaff-5da6-49f6-9a78-6d32aba9c127"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:18:56.585428 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.585409    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j" (OuterVolumeSpecName: "kube-api-access-bxx4j") pod "136dcaff-5da6-49f6-9a78-6d32aba9c127" (UID: "136dcaff-5da6-49f6-9a78-6d32aba9c127"). InnerVolumeSpecName "kube-api-access-bxx4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:18:56.685241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.685217    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxx4j\" (UniqueName: \"kubernetes.io/projected/136dcaff-5da6-49f6-9a78-6d32aba9c127-kube-api-access-bxx4j\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:18:56.685241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:56.685239    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/136dcaff-5da6-49f6-9a78-6d32aba9c127-extensions-socket-volume\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:18:57.160121 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.160093    2563 generic.go:356] "Generic (PLEG): container finished" podID="136dcaff-5da6-49f6-9a78-6d32aba9c127" containerID="d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4" exitCode=0
Jul 20 19:18:57.160238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.160154    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"
Jul 20 19:18:57.160238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.160166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" event={"ID":"136dcaff-5da6-49f6-9a78-6d32aba9c127","Type":"ContainerDied","Data":"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"}
Jul 20 19:18:57.160238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.160210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w" event={"ID":"136dcaff-5da6-49f6-9a78-6d32aba9c127","Type":"ContainerDied","Data":"692b859b8a0ecca7b56b3ec13fde9edbdec423052db0fa51b372a133139bc25a"}
Jul 20 19:18:57.160238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.160232    2563 scope.go:117] "RemoveContainer" containerID="d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"
Jul 20 19:18:57.171699 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.171680    2563 scope.go:117] "RemoveContainer" containerID="d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"
Jul 20 19:18:57.171994 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:18:57.171972    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4\": container with ID starting with d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4 not found: ID does not exist" containerID="d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"
Jul 20 19:18:57.172090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.172007    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4"} err="failed to get container status \"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4\": rpc error: code = NotFound desc = could not find container \"d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4\": container with ID starting with d1ab4f4d503a215aed4d52bd8531bdc25f5fcbe8cc9eab40e8ccfa43515bccf4 not found: ID does not exist"
Jul 20 19:18:57.183237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.183211    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:18:57.187267 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:57.187245    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dzw9w"]
Jul 20 19:18:58.427706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:18:58.427670    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136dcaff-5da6-49f6-9a78-6d32aba9c127" path="/var/lib/kubelet/pods/136dcaff-5da6-49f6-9a78-6d32aba9c127/volumes"
Jul 20 19:19:54.845504 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.845467    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"]
Jul 20 19:19:54.846018 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136dcaff-5da6-49f6-9a78-6d32aba9c127" containerName="manager"
Jul 20 19:19:54.846062 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846021    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="136dcaff-5da6-49f6-9a78-6d32aba9c127" containerName="manager"
Jul 20 19:19:54.846062 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846033    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816ba813-4cd6-49d1-9711-900452f3480c" containerName="cleanup"
Jul 20 19:19:54.846062 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846041    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="816ba813-4cd6-49d1-9711-900452f3480c" containerName="cleanup"
Jul 20 19:19:54.846159 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846148    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="816ba813-4cd6-49d1-9711-900452f3480c" containerName="cleanup"
Jul 20 19:19:54.846194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.846164    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="136dcaff-5da6-49f6-9a78-6d32aba9c127" containerName="manager"
Jul 20 19:19:54.848928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.848902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:54.851650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.851629    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6rzbt\""
Jul 20 19:19:54.860891 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.860865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"]
Jul 20 19:19:54.929905 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.929875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/632a2e01-3066-4a74-a826-f710b8a229ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:54.930035 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:54.929927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjlj\" (UniqueName: \"kubernetes.io/projected/632a2e01-3066-4a74-a826-f710b8a229ea-kube-api-access-wfjlj\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.030271 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.030242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/632a2e01-3066-4a74-a826-f710b8a229ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.030385 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.030283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjlj\" (UniqueName: \"kubernetes.io/projected/632a2e01-3066-4a74-a826-f710b8a229ea-kube-api-access-wfjlj\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.030589 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.030572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/632a2e01-3066-4a74-a826-f710b8a229ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.038750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.038724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjlj\" (UniqueName: \"kubernetes.io/projected/632a2e01-3066-4a74-a826-f710b8a229ea-kube-api-access-wfjlj\") pod \"kuadrant-operator-controller-manager-86878c769f-xfk8h\" (UID: \"632a2e01-3066-4a74-a826-f710b8a229ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.161170 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.161113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.295938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.294507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"]
Jul 20 19:19:55.298712 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:19:55.298684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632a2e01_3066_4a74_a826_f710b8a229ea.slice/crio-41e28eaf63cb962a8c6ad81c7b9cb2309eb228a6e3aae85736f72731ba934c92 WatchSource:0}: Error finding container 41e28eaf63cb962a8c6ad81c7b9cb2309eb228a6e3aae85736f72731ba934c92: Status 404 returned error can't find the container with id 41e28eaf63cb962a8c6ad81c7b9cb2309eb228a6e3aae85736f72731ba934c92
Jul 20 19:19:55.473711 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.473634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h" event={"ID":"632a2e01-3066-4a74-a826-f710b8a229ea","Type":"ContainerStarted","Data":"ae3322d72bf37061bad3324e2c35e94998d7ba3750f4d73fc9c9b5e2e0e1357b"}
Jul 20 19:19:55.473836 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.473787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:19:55.473879 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.473829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h" event={"ID":"632a2e01-3066-4a74-a826-f710b8a229ea","Type":"ContainerStarted","Data":"41e28eaf63cb962a8c6ad81c7b9cb2309eb228a6e3aae85736f72731ba934c92"}
Jul 20 19:19:55.498603 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:19:55.498562    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h" podStartSLOduration=1.498548929 podStartE2EDuration="1.498548929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:19:55.496452322 +0000 UTC m=+1155.677975511" watchObservedRunningTime="2026-07-20 19:19:55.498548929 +0000 UTC m=+1155.680072120"
Jul 20 19:20:06.480542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:20:06.480512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xfk8h"
Jul 20 19:20:40.353969 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:20:40.353942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:20:40.358767 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:20:40.358733    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:25:40.394626 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:25:40.394596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:25:40.402894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:25:40.402876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:27:12.121717 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.121680    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:27:12.125167 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.125150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.127948 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.127926    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b1e95d9e-openshift-default-dockercfg-qs7ww\""
Jul 20 19:27:12.156396 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.156368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:27:12.211907 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.211865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.211927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.211957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212326 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212326 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6w7t\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212326 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.212326 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.212250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313030 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.312990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313030 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313521 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313521 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6w7t\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313521 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313680 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313680 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313575    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313884 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.313997 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.313980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.315493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.315463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.316016 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.315996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.325718 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.325692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.326312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.326295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6w7t\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t\") pod \"e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") " pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.434876 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.434788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:12.589548 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.589521    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:27:12.591401 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:27:12.591372    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515370c9_4485_4086_b1ae_5f445c2927c3.slice/crio-720534fc470f09dbe927f6ddf2de0eac593221e2d3408a41b4af5709e4bd159b WatchSource:0}: Error finding container 720534fc470f09dbe927f6ddf2de0eac593221e2d3408a41b4af5709e4bd159b: Status 404 returned error can't find the container with id 720534fc470f09dbe927f6ddf2de0eac593221e2d3408a41b4af5709e4bd159b
Jul 20 19:27:12.593414 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.593382    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:12.593486 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.593451    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:12.593524 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.593482    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:12.865017 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.864980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerStarted","Data":"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"}
Jul 20 19:27:12.865187 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.865037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerStarted","Data":"720534fc470f09dbe927f6ddf2de0eac593221e2d3408a41b4af5709e4bd159b"}
Jul 20 19:27:12.893559 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:12.893514    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podStartSLOduration=0.893499982 podStartE2EDuration="893.499982ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:12.89256415 +0000 UTC m=+1593.074087340" watchObservedRunningTime="2026-07-20 19:27:12.893499982 +0000 UTC m=+1593.075023170"
Jul 20 19:27:13.435665 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:13.435634    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:13.440401 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:13.440374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:13.870627 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:13.870597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:13.871614 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:13.871597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:27.947380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.947347    2563 generic.go:356] "Generic (PLEG): container finished" podID="515370c9-4485-4086-b1ae-5f445c2927c3" containerID="1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2" exitCode=0
Jul 20 19:27:27.947833 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.947425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerDied","Data":"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"}
Jul 20 19:27:27.947971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.947948    2563 scope.go:117] "RemoveContainer" containerID="1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"
Jul 20 19:27:27.949154 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.949124    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:27.949225 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.949212    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:27.949269 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:27.949258    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:28.871119 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:28.871089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:28.957908 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:28.957879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerStarted","Data":"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"}
Jul 20 19:27:29.434977 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:29.434931    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:29.436151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:29.436123    2563 patch_prober.go:28] interesting pod/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 20 19:27:29.436278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:29.436174    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 20 19:27:30.435411 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:30.435377    2563 patch_prober.go:28] interesting pod/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 20 19:27:30.435814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:30.435426    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 20 19:27:31.435474 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:31.435434    2563 patch_prober.go:28] interesting pod/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 20 19:27:31.435938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:31.435496    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 20 19:27:32.436189 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:32.436110    2563 patch_prober.go:28] interesting pod/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 20 19:27:32.436189 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:32.436166    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 20 19:27:33.439631 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:33.439598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:33.440098 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:33.439887    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:33.440558 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:33.440543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:27:55.175859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:55.175821    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:27:55.176422 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:55.176062    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy" containerID="cri-o://d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275" gracePeriod=30
Jul 20 19:27:56.285837 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.285804    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:27:56.290011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.289991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.293783 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.293744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8c4bb01a-gw-openshift-default-dockercfg-hbkbr\""
Jul 20 19:27:56.317243 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:27:56.317635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrh4\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.317913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.317899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrh4\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.418705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.418790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.419102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.419130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.419229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.419370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.419457 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.419397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.421229 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.421201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.421390 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.421328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.428975 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.428950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrh4\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.429870 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.429846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token\") pod \"e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") " pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.600879 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.600797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:56.749360 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.749330    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:27:56.751779 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:27:56.751484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2bafd2_4125_4131_918c_b19f303518c5.slice/crio-06848893ed1d68de17e6d08e5c5c70db6fb38e104bf8f33a1b91b6ea67a7bcb2 WatchSource:0}: Error finding container 06848893ed1d68de17e6d08e5c5c70db6fb38e104bf8f33a1b91b6ea67a7bcb2: Status 404 returned error can't find the container with id 06848893ed1d68de17e6d08e5c5c70db6fb38e104bf8f33a1b91b6ea67a7bcb2
Jul 20 19:27:56.754011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.753975    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:56.754110 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.754057    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:56.754110 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:56.754097    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:27:57.119462 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:57.119416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerStarted","Data":"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"}
Jul 20 19:27:57.119657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:57.119474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerStarted","Data":"06848893ed1d68de17e6d08e5c5c70db6fb38e104bf8f33a1b91b6ea67a7bcb2"}
Jul 20 19:27:57.146564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:57.146506    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podStartSLOduration=1.1464847360000001 podStartE2EDuration="1.146484736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:27:57.144230931 +0000 UTC m=+1637.325754132" watchObservedRunningTime="2026-07-20 19:27:57.146484736 +0000 UTC m=+1637.328007929"
Jul 20 19:27:57.601775 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:57.601721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:57.606409 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:57.606387    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:58.125281 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:58.125254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:27:58.126180 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:27:58.126163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:00.432720 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.432698    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:28:00.553320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553284    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553342    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553428    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:00.553839 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553797    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.553839 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553830    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.554008 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6w7t\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.554008 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.553941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket\") pod \"515370c9-4485-4086-b1ae-5f445c2927c3\" (UID: \"515370c9-4485-4086-b1ae-5f445c2927c3\") "
Jul 20 19:28:00.554217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.554181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:00.554336 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.554242    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.554446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.554429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:00.555034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.554961    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:00.555034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.554966    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:28:00.556081 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.556045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:00.556081 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.556047    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:28:00.556694 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.556626    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t" (OuterVolumeSpecName: "kube-api-access-z6w7t") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "kube-api-access-z6w7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:28:00.556945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.556928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "515370c9-4485-4086-b1ae-5f445c2927c3" (UID: "515370c9-4485-4086-b1ae-5f445c2927c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:28:00.654604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654572    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6w7t\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-kube-api-access-z6w7t\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654599    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654611    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654620    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/515370c9-4485-4086-b1ae-5f445c2927c3-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654629    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654639    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/515370c9-4485-4086-b1ae-5f445c2927c3-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654647    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/515370c9-4485-4086-b1ae-5f445c2927c3-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:00.654859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:00.654654    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/515370c9-4485-4086-b1ae-5f445c2927c3-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:01.144559 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.144523    2563 generic.go:356] "Generic (PLEG): container finished" podID="515370c9-4485-4086-b1ae-5f445c2927c3" containerID="d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275" exitCode=0
Jul 20 19:28:01.144748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.144572    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"
Jul 20 19:28:01.144748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.144604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerDied","Data":"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"}
Jul 20 19:28:01.144748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.144667    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm" event={"ID":"515370c9-4485-4086-b1ae-5f445c2927c3","Type":"ContainerDied","Data":"720534fc470f09dbe927f6ddf2de0eac593221e2d3408a41b4af5709e4bd159b"}
Jul 20 19:28:01.144748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.144698    2563 scope.go:117] "RemoveContainer" containerID="d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"
Jul 20 19:28:01.154636 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.154620    2563 scope.go:117] "RemoveContainer" containerID="1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"
Jul 20 19:28:01.163215 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.163197    2563 scope.go:117] "RemoveContainer" containerID="d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"
Jul 20 19:28:01.163465 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:28:01.163442    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275\": container with ID starting with d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275 not found: ID does not exist" containerID="d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"
Jul 20 19:28:01.163517 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.163476    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275"} err="failed to get container status \"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275\": rpc error: code = NotFound desc = could not find container \"d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275\": container with ID starting with d201963f9c20ee8539e19f091faea8ac39b14e546a3bdcb62c4f93a60a101275 not found: ID does not exist"
Jul 20 19:28:01.163517 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.163498    2563 scope.go:117] "RemoveContainer" containerID="1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"
Jul 20 19:28:01.163773 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:28:01.163738    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2\": container with ID starting with 1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2 not found: ID does not exist" containerID="1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"
Jul 20 19:28:01.163853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.163779    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2"} err="failed to get container status \"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2\": rpc error: code = NotFound desc = could not find container \"1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2\": container with ID starting with 1feb3f496f68ce22fcc82d94ad8aa69021b0017da54ef11eb7cabf4ac5aff1a2 not found: ID does not exist"
Jul 20 19:28:01.168732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.168709    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:28:01.172152 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:01.172125    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b1e95d9e-openshift-default-76d457d7bc-mlfdm"]
Jul 20 19:28:02.427258 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:02.427228    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" path="/var/lib/kubelet/pods/515370c9-4485-4086-b1ae-5f445c2927c3/volumes"
Jul 20 19:28:11.221035 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.221002    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e2bafd2-4125-4131-918c-b19f303518c5" containerID="d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d" exitCode=0
Jul 20 19:28:11.221476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.221075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerDied","Data":"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"}
Jul 20 19:28:11.221476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.221464    2563 scope.go:117] "RemoveContainer" containerID="d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"
Jul 20 19:28:11.222455 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.222427    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:11.222555 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.222513    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:11.222619 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:11.222563    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:12.228929 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:12.228889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerStarted","Data":"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"}
Jul 20 19:28:12.601471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:12.601428    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:12.602682 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:12.602653    2563 patch_prober.go:28] interesting pod/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 20 19:28:12.602830 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:12.602709    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 20 19:28:13.126014 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:13.125975    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:13.602182 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:13.602146    2563 patch_prober.go:28] interesting pod/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 20 19:28:13.602567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:13.602211    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 20 19:28:14.601981 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:14.601949    2563 patch_prober.go:28] interesting pod/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 20 19:28:14.602169 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:14.602001    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 20 19:28:15.601597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:15.601560    2563 patch_prober.go:28] interesting pod/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 20 19:28:15.602085 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:15.601620    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 20 19:28:16.605654 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:16.605616    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:16.606530 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:16.606512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:38.968377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:38.968336    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:28:38.968979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:38.968581    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy" containerID="cri-o://43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3" gracePeriod=30
Jul 20 19:28:39.810255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810223    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:28:39.810620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810606    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.810676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810621    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.810676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810640    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.810676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810646    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.810802 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810710    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.810802 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.810719    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="515370c9-4485-4086-b1ae-5f445c2927c3" containerName="istio-proxy"
Jul 20 19:28:39.813897 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.813881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.817908 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.817886    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c0f5505a-openshift-default-dockercfg-pg4hf\""
Jul 20 19:28:39.838691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.838668    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:28:39.895397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq8w9\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.895732 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.895723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.996564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.996564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.996833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq8w9\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997427 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.997132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997427 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.997199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997427 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.997405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997427 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.997420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.997632 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.997504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.999106 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.999082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:39.999212 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:39.999185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:40.009722 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.009696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:40.009883 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.009855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq8w9\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9\") pod \"e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") " pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:40.123945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.123869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:40.268588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.268561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:28:40.269556 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:28:40.269509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3e03bd_4942_4411_abc8_f9f619adaa6c.slice/crio-8626287141b9d508ae8fb80bfc2ca58da6f0d1a511200a319ed3afb837d5ddc7 WatchSource:0}: Error finding container 8626287141b9d508ae8fb80bfc2ca58da6f0d1a511200a319ed3afb837d5ddc7: Status 404 returned error can't find the container with id 8626287141b9d508ae8fb80bfc2ca58da6f0d1a511200a319ed3afb837d5ddc7
Jul 20 19:28:40.271579 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.271551    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:40.271676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.271627    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:40.271737 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.271672    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:40.389172 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.389086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerStarted","Data":"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"}
Jul 20 19:28:40.389172 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.389150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerStarted","Data":"8626287141b9d508ae8fb80bfc2ca58da6f0d1a511200a319ed3afb837d5ddc7"}
Jul 20 19:28:40.423238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:40.423179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podStartSLOduration=1.4231575300000001 podStartE2EDuration="1.42315753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:40.414180292 +0000 UTC m=+1680.595703482" watchObservedRunningTime="2026-07-20 19:28:40.42315753 +0000 UTC m=+1680.604680720"
Jul 20 19:28:41.124468 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:41.124437    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:41.129496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:41.129461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:41.394519 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:41.394443    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:41.395274 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:41.395251    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:44.230907 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.230847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:44.337154 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337303 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337246    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zrh4\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337303 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337346    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:44.337393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337420    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337446    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337502 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337467    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337649 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337560    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy\") pod \"8e2bafd2-4125-4131-918c-b19f303518c5\" (UID: \"8e2bafd2-4125-4131-918c-b19f303518c5\") "
Jul 20 19:28:44.337730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:44.337821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:44.337821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337714    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:28:44.337944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337922    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.338009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337950    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.338009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337964    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.338009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.337979    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e2bafd2-4125-4131-918c-b19f303518c5-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.338532 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.338502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:44.339513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.339492    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:28:44.339513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.339503    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4" (OuterVolumeSpecName: "kube-api-access-7zrh4") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "kube-api-access-7zrh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:28:44.339657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.339522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:28:44.339657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.339631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e2bafd2-4125-4131-918c-b19f303518c5" (UID: "8e2bafd2-4125-4131-918c-b19f303518c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:28:44.412351 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.412316    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e2bafd2-4125-4131-918c-b19f303518c5" containerID="43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3" exitCode=0
Jul 20 19:28:44.412514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.412359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerDied","Data":"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"}
Jul 20 19:28:44.412514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.412374    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"
Jul 20 19:28:44.412514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.412418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6" event={"ID":"8e2bafd2-4125-4131-918c-b19f303518c5","Type":"ContainerDied","Data":"06848893ed1d68de17e6d08e5c5c70db6fb38e104bf8f33a1b91b6ea67a7bcb2"}
Jul 20 19:28:44.412514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.412443    2563 scope.go:117] "RemoveContainer" containerID="43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"
Jul 20 19:28:44.421947 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.421924    2563 scope.go:117] "RemoveContainer" containerID="d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"
Jul 20 19:28:44.432490 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.432470    2563 scope.go:117] "RemoveContainer" containerID="43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"
Jul 20 19:28:44.432765 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:28:44.432733    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3\": container with ID starting with 43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3 not found: ID does not exist" containerID="43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"
Jul 20 19:28:44.432848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.432789    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3"} err="failed to get container status \"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3\": rpc error: code = NotFound desc = could not find container \"43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3\": container with ID starting with 43a294e1a1c36dfc80288f3895fccfea41d9ddd98f5acc7635bf6f450f8a01e3 not found: ID does not exist"
Jul 20 19:28:44.432848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.432815    2563 scope.go:117] "RemoveContainer" containerID="d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"
Jul 20 19:28:44.433094 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:28:44.433078    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d\": container with ID starting with d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d not found: ID does not exist" containerID="d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"
Jul 20 19:28:44.433153 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.433106    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d"} err="failed to get container status \"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d\": rpc error: code = NotFound desc = could not find container \"d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d\": container with ID starting with d824fb9ff25596561b771e3843b5b19bd7405065b4ae9c408946ea7bd8a3ae6d not found: ID does not exist"
Jul 20 19:28:44.438548 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.438531    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.438612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.438549    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.438612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.438558    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e2bafd2-4125-4131-918c-b19f303518c5-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.438612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.438566    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zrh4\" (UniqueName: \"kubernetes.io/projected/8e2bafd2-4125-4131-918c-b19f303518c5-kube-api-access-7zrh4\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.438612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.438575    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e2bafd2-4125-4131-918c-b19f303518c5-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:28:44.452420 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.452396    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:28:44.465851 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:44.465819    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8c4bb01a-gw-openshift-default-769d8bc59f-72wn6"]
Jul 20 19:28:46.428628 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:46.428594    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" path="/var/lib/kubelet/pods/8e2bafd2-4125-4131-918c-b19f303518c5/volumes"
Jul 20 19:28:56.994994 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:56.993625    2563 patch_prober.go:28] interesting pod/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:36196->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 20 19:28:56.994994 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:56.993697    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:36196->10.133.0.59:15021: read: connection reset by peer"
Jul 20 19:28:57.508022 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.507986    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerID="f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93" exitCode=0
Jul 20 19:28:57.508235 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.508059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerDied","Data":"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"}
Jul 20 19:28:57.508483 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.508470    2563 scope.go:117] "RemoveContainer" containerID="f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"
Jul 20 19:28:57.509578 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.509550    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:57.509652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.509636    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:57.509718 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:57.509679    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:28:58.515716 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:58.515680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerStarted","Data":"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"}
Jul 20 19:28:59.124940 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:59.124901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:28:59.125126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:59.125100    2563 patch_prober.go:28] interesting pod/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 20 19:28:59.125182 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:28:59.125142    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 20 19:29:00.124710 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:00.124671    2563 patch_prober.go:28] interesting pod/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 20 19:29:00.125148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:00.124727    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 20 19:29:01.125289 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:01.125249    2563 patch_prober.go:28] interesting pod/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 20 19:29:01.125691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:01.125307    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 20 19:29:02.125170 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:02.125083    2563 patch_prober.go:28] interesting pod/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 20 19:29:02.125170 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:02.125142    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 20 19:29:03.127526 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:03.127498    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:29:03.127943 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:03.127861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:29:03.128575 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:03.128561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:29:24.043384 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.043351    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:29:24.043856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.043567    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy" containerID="cri-o://a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480" gracePeriod=30
Jul 20 19:29:24.931024 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.930991    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:29:24.931403 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931390    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.931446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931404    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.931446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931412    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.931446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931417    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.931542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931487    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.931542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.931495    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2bafd2-4125-4131-918c-b19f303518c5" containerName="istio-proxy"
Jul 20 19:29:24.934655 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.934638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:24.948013 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.947979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1e283793-openshift-default-dockercfg-hn8j8\""
Jul 20 19:29:24.969062 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:24.969028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:29:25.000521 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjnw\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000689 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.000945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.000843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.101604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.101604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjnw\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.101825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102205 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.102066    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.102363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.102431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.102482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.102843 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.102822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.103942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.103925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.104314 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.104295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.116569 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.116545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.122523 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.122500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjnw\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw\") pod \"e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") " pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.245229 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.245197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:25.394289 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.394258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:29:25.395578 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:29:25.395556    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfae6b8_8d04_4567_9f61_9fd9941c9800.slice/crio-1f4d2b99b0443fa17c749aec283d26d56163d91c0cc65e4e24d060ccab830347 WatchSource:0}: Error finding container 1f4d2b99b0443fa17c749aec283d26d56163d91c0cc65e4e24d060ccab830347: Status 404 returned error can't find the container with id 1f4d2b99b0443fa17c749aec283d26d56163d91c0cc65e4e24d060ccab830347
Jul 20 19:29:25.398045 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.398012    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:25.398124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.398074    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:25.398124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.398102    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:25.669397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.669305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerStarted","Data":"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"}
Jul 20 19:29:25.669397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.669374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerStarted","Data":"1f4d2b99b0443fa17c749aec283d26d56163d91c0cc65e4e24d060ccab830347"}
Jul 20 19:29:25.692837 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:25.692776    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podStartSLOduration=1.692737264 podStartE2EDuration="1.692737264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:25.691460436 +0000 UTC m=+1725.872983619" watchObservedRunningTime="2026-07-20 19:29:25.692737264 +0000 UTC m=+1725.874260455"
Jul 20 19:29:26.245982 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:26.245949    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:26.251219 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:26.251193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:26.674855 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:26.674750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:26.675831 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:26.675807    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:29.300330 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.300294    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:29:29.449288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449245    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq8w9\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449425    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449580 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert\") pod \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\" (UID: \"bd3e03bd-4942-4411-abc8-f9f619adaa6c\") "
Jul 20 19:29:29.449878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:29:29.449878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:29:29.449878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449862    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.450035 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449883    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.450035 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.449890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:29:29.450136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.450083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:29:29.450274 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.450251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:29:29.452000 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.451883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:29:29.452133 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.452028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:29:29.452133 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.452109    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:29:29.452276 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.452257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9" (OuterVolumeSpecName: "kube-api-access-nq8w9") pod "bd3e03bd-4942-4411-abc8-f9f619adaa6c" (UID: "bd3e03bd-4942-4411-abc8-f9f619adaa6c"). InnerVolumeSpecName "kube-api-access-nq8w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:29:29.551078 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551037    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551078 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551075    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551090    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551103    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551116    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551129    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq8w9\" (UniqueName: \"kubernetes.io/projected/bd3e03bd-4942-4411-abc8-f9f619adaa6c-kube-api-access-nq8w9\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.551334 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.551144    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd3e03bd-4942-4411-abc8-f9f619adaa6c-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:29:29.694746 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.694711    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerID="a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480" exitCode=0
Jul 20 19:29:29.694938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.694777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"
Jul 20 19:29:29.694938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.694800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerDied","Data":"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"}
Jul 20 19:29:29.694938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.694861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq" event={"ID":"bd3e03bd-4942-4411-abc8-f9f619adaa6c","Type":"ContainerDied","Data":"8626287141b9d508ae8fb80bfc2ca58da6f0d1a511200a319ed3afb837d5ddc7"}
Jul 20 19:29:29.694938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.694892    2563 scope.go:117] "RemoveContainer" containerID="a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"
Jul 20 19:29:29.704221 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.704202    2563 scope.go:117] "RemoveContainer" containerID="f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"
Jul 20 19:29:29.712922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.712905    2563 scope.go:117] "RemoveContainer" containerID="a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"
Jul 20 19:29:29.713160 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:29:29.713141    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480\": container with ID starting with a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480 not found: ID does not exist" containerID="a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"
Jul 20 19:29:29.713201 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.713171    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480"} err="failed to get container status \"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480\": rpc error: code = NotFound desc = could not find container \"a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480\": container with ID starting with a38fc160a1d34e45f20ced53502869583e4eff3ac2cfa9f2635db64261d64480 not found: ID does not exist"
Jul 20 19:29:29.713201 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.713189    2563 scope.go:117] "RemoveContainer" containerID="f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"
Jul 20 19:29:29.713446 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:29:29.713430    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93\": container with ID starting with f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93 not found: ID does not exist" containerID="f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"
Jul 20 19:29:29.713479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.713453    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93"} err="failed to get container status \"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93\": rpc error: code = NotFound desc = could not find container \"f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93\": container with ID starting with f4573c76644025f420c8cff140c08a9b478d60cd07d629e43e1b3da8740daa93 not found: ID does not exist"
Jul 20 19:29:29.719256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.719233    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:29:29.723406 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:29.723385    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c0f5505a-openshift-default-5569b5697c-9wlgq"]
Jul 20 19:29:30.428556 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:30.428520    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" path="/var/lib/kubelet/pods/bd3e03bd-4942-4411-abc8-f9f619adaa6c/volumes"
Jul 20 19:29:41.676376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.676340    2563 patch_prober.go:28] interesting pod/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 20 19:29:41.676793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.676409    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 20 19:29:41.767514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.767480    2563 generic.go:356] "Generic (PLEG): container finished" podID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerID="70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9" exitCode=0
Jul 20 19:29:41.767698 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.767559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerDied","Data":"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"}
Jul 20 19:29:41.767994 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.767977    2563 scope.go:117] "RemoveContainer" containerID="70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"
Jul 20 19:29:41.768974 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.768948    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:41.769036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.769018    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:41.769071 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:41.769052    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:29:42.779147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:42.779108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerStarted","Data":"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"}
Jul 20 19:29:43.246397 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:43.246369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:43.246597 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:43.246574    2563 patch_prober.go:28] interesting pod/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 20 19:29:43.246651 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:43.246632    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 20 19:29:44.246120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:44.246080    2563 patch_prober.go:28] interesting pod/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 20 19:29:44.246598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:44.246145    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 20 19:29:45.245684 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:45.245644    2563 patch_prober.go:28] interesting pod/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 20 19:29:45.245925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:45.245711    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 20 19:29:46.246476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:46.246435    2563 patch_prober.go:28] interesting pod/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 20 19:29:46.246932 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:46.246511    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 20 19:29:47.249555 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:47.249524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:47.249999 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:47.249786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:29:47.250421 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:29:47.250406    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:30:07.248850 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:07.248812    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:30:07.249356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:07.249060    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy" containerID="cri-o://0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b" gracePeriod=30
Jul 20 19:30:12.515687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.515612    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:30:12.620486 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmjnw\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620663    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.620989 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.620953    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:30:12.621145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.621224 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.621286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621230    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket\") pod \"acfae6b8-8d04-4567-9f61-9fd9941c9800\" (UID: \"acfae6b8-8d04-4567-9f61-9fd9941c9800\") "
Jul 20 19:30:12.621339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:30:12.621623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621394    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:30:12.621623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621559    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:30:12.621623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621595    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.621623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621617    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.621928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621631    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfae6b8-8d04-4567-9f61-9fd9941c9800-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.621928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.621713    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data" (OuterVolumeSpecName: "istio-data") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:30:12.623347 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.623307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw" (OuterVolumeSpecName: "kube-api-access-nmjnw") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "kube-api-access-nmjnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:30:12.623608 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.623588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:30:12.623674 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.623647    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:30:12.623842 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.623822    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token" (OuterVolumeSpecName: "istio-token") pod "acfae6b8-8d04-4567-9f61-9fd9941c9800" (UID: "acfae6b8-8d04-4567-9f61-9fd9941c9800"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:30:12.722333 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722296    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.722333 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722328    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.722333 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722338    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmjnw\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-kube-api-access-nmjnw\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.722568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722348    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.722568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722357    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfae6b8-8d04-4567-9f61-9fd9941c9800-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.722568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.722364    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfae6b8-8d04-4567-9f61-9fd9941c9800-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:30:12.945356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.945267    2563 generic.go:356] "Generic (PLEG): container finished" podID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerID="0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b" exitCode=0
Jul 20 19:30:12.945356 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.945322    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"
Jul 20 19:30:12.945543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.945355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerDied","Data":"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"}
Jul 20 19:30:12.945543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.945433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb" event={"ID":"acfae6b8-8d04-4567-9f61-9fd9941c9800","Type":"ContainerDied","Data":"1f4d2b99b0443fa17c749aec283d26d56163d91c0cc65e4e24d060ccab830347"}
Jul 20 19:30:12.945543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.945458    2563 scope.go:117] "RemoveContainer" containerID="0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"
Jul 20 19:30:12.956292 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.956273    2563 scope.go:117] "RemoveContainer" containerID="70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"
Jul 20 19:30:12.964836 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.964813    2563 scope.go:117] "RemoveContainer" containerID="0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"
Jul 20 19:30:12.965086 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:30:12.965068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b\": container with ID starting with 0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b not found: ID does not exist" containerID="0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"
Jul 20 19:30:12.965143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.965095    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b"} err="failed to get container status \"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b\": rpc error: code = NotFound desc = could not find container \"0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b\": container with ID starting with 0196cd61258dfdc8df8b2b18c7186b78128d102f4350866cfd51ac4493feb27b not found: ID does not exist"
Jul 20 19:30:12.965143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.965113    2563 scope.go:117] "RemoveContainer" containerID="70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"
Jul 20 19:30:12.965331 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:30:12.965316    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9\": container with ID starting with 70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9 not found: ID does not exist" containerID="70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"
Jul 20 19:30:12.965380 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.965336    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9"} err="failed to get container status \"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9\": rpc error: code = NotFound desc = could not find container \"70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9\": container with ID starting with 70679cbcfdb2197a7ef8bdbe3cacf735cc2e212fc57742d29ca1be8e4162e5b9 not found: ID does not exist"
Jul 20 19:30:12.972609 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.972587    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:30:12.974925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:12.974905    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1e283793-openshift-default-66ccf6c8c5-krmlb"]
Jul 20 19:30:14.426976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:14.426945    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" path="/var/lib/kubelet/pods/acfae6b8-8d04-4567-9f61-9fd9941c9800/volumes"
Jul 20 19:30:40.435415 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:40.435380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:30:40.443671 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:30:40.443648    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:31:47.744943 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.744904    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:31:47.745533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745495    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:31:47.745533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745542    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745552    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745566    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745575    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745587    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.745653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745595    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.745964 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745696    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.745964 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745708    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:31:47.745964 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.745718    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd3e03bd-4942-4411-abc8-f9f619adaa6c" containerName="istio-proxy"
Jul 20 19:31:47.749066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.749041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.751985 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.751961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-088e4681-openshift-default-dockercfg-g7lls\""
Jul 20 19:31:47.758410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzf5\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758726 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758726 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.758726 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.758650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.776150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.776121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:31:47.860012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.859979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzf5\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860206 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860588 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860708 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.860871 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.860860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.861032 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.861011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.862595 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.862568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.862727 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.862686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.869883 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.869860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:47.870148 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:47.870130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzf5\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5\") pod \"e2e-mt-088e4681-openshift-default-fd556567f-ctczh\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") " pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:48.060333 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.060254    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:48.220264 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.220233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:31:48.221259 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:31:48.221228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccd7af0_3336_457b_8bdf_d8d901343308.slice/crio-de7ead7e44838bc271fc2316f74dfa3f884fa43012c44abde091feccf183ef25 WatchSource:0}: Error finding container de7ead7e44838bc271fc2316f74dfa3f884fa43012c44abde091feccf183ef25: Status 404 returned error can't find the container with id de7ead7e44838bc271fc2316f74dfa3f884fa43012c44abde091feccf183ef25
Jul 20 19:31:48.223492 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.223459    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:31:48.223568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.223528    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:31:48.223568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.223560    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:31:48.495181 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.495142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerStarted","Data":"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"}
Jul 20 19:31:48.495375 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.495205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerStarted","Data":"de7ead7e44838bc271fc2316f74dfa3f884fa43012c44abde091feccf183ef25"}
Jul 20 19:31:48.521120 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:48.521070    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podStartSLOduration=1.521054159 podStartE2EDuration="1.521054159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:31:48.518148077 +0000 UTC m=+1868.699671302" watchObservedRunningTime="2026-07-20 19:31:48.521054159 +0000 UTC m=+1868.702577347"
Jul 20 19:31:49.060788 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:49.060738    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:49.065998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:49.065974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:49.506272 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:49.506239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:31:49.510836 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:31:49.510808    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:04.507302 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.507266    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 20 19:32:04.507676 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.507324    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 20 19:32:04.602418 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.602337    2563 generic.go:356] "Generic (PLEG): container finished" podID="bccd7af0-3336-457b-8bdf-d8d901343308" containerID="9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e" exitCode=0
Jul 20 19:32:04.602567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.602410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerDied","Data":"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"}
Jul 20 19:32:04.602859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.602839    2563 scope.go:117] "RemoveContainer" containerID="9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"
Jul 20 19:32:04.603820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.603795    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:04.603881 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.603857    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:04.603927 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:04.603887    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:05.613378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:05.613342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerStarted","Data":"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"}
Jul 20 19:32:06.061377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:06.061340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:06.061812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:06.061699    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 20 19:32:06.062021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:06.061998    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 20 19:32:07.061497 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:07.061455    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 20 19:32:07.062046 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:07.061526    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 20 19:32:08.061253 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:08.061215    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 20 19:32:08.061564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:08.061533    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 20 19:32:09.061703 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:09.061656    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 20 19:32:09.062215 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:09.061726    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 20 19:32:10.064404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:10.064366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:10.064911 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:10.064660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:10.065347 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:10.065331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:24.170252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:24.170218    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:32:24.170701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:24.170423    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" containerID="cri-o://a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54" gracePeriod=30
Jul 20 19:32:25.067574 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:25.067531    2563 patch_prober.go:28] interesting pod/e2e-mt-088e4681-openshift-default-fd556567f-ctczh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 19:32:25.067771 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:25.067611    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:32:29.428137 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.428113    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:29.441652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441605    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.441734 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.441734 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqzf5\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.441734 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441708    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.441734 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441730    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.441911 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441780    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.442013 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.441993    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.442085 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442035    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:32:29.442085 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.442194 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo\") pod \"bccd7af0-3336-457b-8bdf-d8d901343308\" (UID: \"bccd7af0-3336-457b-8bdf-d8d901343308\") "
Jul 20 19:32:29.442241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442126    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:32:29.442297 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:32:29.442394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442366    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bccd7af0-3336-457b-8bdf-d8d901343308-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.442394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442385    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.442394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442394    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.442784 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442732    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data" (OuterVolumeSpecName: "istio-data") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:32:29.442960 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.442940    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:32:29.443838 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.443820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:32:29.444067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.444047    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:32:29.444230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.444211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5" (OuterVolumeSpecName: "kube-api-access-tqzf5") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "kube-api-access-tqzf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:32:29.444285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.444211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token" (OuterVolumeSpecName: "istio-token") pod "bccd7af0-3336-457b-8bdf-d8d901343308" (UID: "bccd7af0-3336-457b-8bdf-d8d901343308"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:32:29.543503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543467    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqzf5\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-kube-api-access-tqzf5\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.543503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543502    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bccd7af0-3336-457b-8bdf-d8d901343308-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.543733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543513    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.543733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543524    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bccd7af0-3336-457b-8bdf-d8d901343308-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.543733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543534    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.543733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.543546    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bccd7af0-3336-457b-8bdf-d8d901343308-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:32:29.755834 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.755786    2563 generic.go:356] "Generic (PLEG): container finished" podID="bccd7af0-3336-457b-8bdf-d8d901343308" containerID="a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54" exitCode=0
Jul 20 19:32:29.755834 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.755833    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"
Jul 20 19:32:29.756074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.755868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerDied","Data":"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"}
Jul 20 19:32:29.756074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.755948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh" event={"ID":"bccd7af0-3336-457b-8bdf-d8d901343308","Type":"ContainerDied","Data":"de7ead7e44838bc271fc2316f74dfa3f884fa43012c44abde091feccf183ef25"}
Jul 20 19:32:29.756074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.755969    2563 scope.go:117] "RemoveContainer" containerID="a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"
Jul 20 19:32:29.765583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.765567    2563 scope.go:117] "RemoveContainer" containerID="9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"
Jul 20 19:32:29.773586 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.773572    2563 scope.go:117] "RemoveContainer" containerID="a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"
Jul 20 19:32:29.773830 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:32:29.773812    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54\": container with ID starting with a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54 not found: ID does not exist" containerID="a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"
Jul 20 19:32:29.773884 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.773838    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54"} err="failed to get container status \"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54\": rpc error: code = NotFound desc = could not find container \"a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54\": container with ID starting with a16ceb9d775d056c4b23bee65b647b69990b9de59dcbe561a9a03873a216fb54 not found: ID does not exist"
Jul 20 19:32:29.773884 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.773853    2563 scope.go:117] "RemoveContainer" containerID="9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"
Jul 20 19:32:29.774091 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:32:29.774075    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e\": container with ID starting with 9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e not found: ID does not exist" containerID="9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"
Jul 20 19:32:29.774137 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.774093    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e"} err="failed to get container status \"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e\": rpc error: code = NotFound desc = could not find container \"9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e\": container with ID starting with 9d40c820af4a680b497a29953e73583588fa997d393cf7c60611b890f20b4a3e not found: ID does not exist"
Jul 20 19:32:29.780389 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.780369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:32:29.785091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:29.785068    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-088e4681-openshift-default-fd556567f-ctczh"]
Jul 20 19:32:30.429591 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:30.429558    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" path="/var/lib/kubelet/pods/bccd7af0-3336-457b-8bdf-d8d901343308/volumes"
Jul 20 19:32:44.120640 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.120599    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:32:44.121097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121031    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121043    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121063    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121136    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121144    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bccd7af0-3336-457b-8bdf-d8d901343308" containerName="istio-proxy"
Jul 20 19:32:44.121227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.121157    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfae6b8-8d04-4567-9f61-9fd9941c9800" containerName="istio-proxy"
Jul 20 19:32:44.124578 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.124559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.127593 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.127571    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-18f84c7f-openshift-default-dockercfg-74kvk\""
Jul 20 19:32:44.151331 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.151306    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:32:44.171984 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.171956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hq8r\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.172378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.172292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hq8r\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273355 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273355 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273355 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273773 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.273949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.273926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.274183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.274163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.275696 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.275679    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.275773 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.275744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.283891 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.283864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hq8r\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.287613 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.287584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token\") pod \"e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") " pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.434921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.434835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:44.608723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.608691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:32:44.612014 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:32:44.611988    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b243d86_e7a1_48f9_8f0a_f2738c73366d.slice/crio-9111b988f1dfbc3aa0d708cf4f2f44129a4b0ef9d79e4ad03755eeb4e9e58f89 WatchSource:0}: Error finding container 9111b988f1dfbc3aa0d708cf4f2f44129a4b0ef9d79e4ad03755eeb4e9e58f89: Status 404 returned error can't find the container with id 9111b988f1dfbc3aa0d708cf4f2f44129a4b0ef9d79e4ad03755eeb4e9e58f89
Jul 20 19:32:44.614180 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.614151    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:44.614258 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.614214    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:44.614258 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.614241    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:44.842163 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.842124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerStarted","Data":"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"}
Jul 20 19:32:44.842374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.842184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerStarted","Data":"9111b988f1dfbc3aa0d708cf4f2f44129a4b0ef9d79e4ad03755eeb4e9e58f89"}
Jul 20 19:32:44.864548 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:44.864486    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podStartSLOduration=0.864461428 podStartE2EDuration="864.461428ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:44.864266641 +0000 UTC m=+1925.045789870" watchObservedRunningTime="2026-07-20 19:32:44.864461428 +0000 UTC m=+1925.045984617"
Jul 20 19:32:45.435438 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:45.435403    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:45.440289 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:45.440261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:45.847969 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:45.847935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:45.848891 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:45.848866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:32:56.015199 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.015162    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:32:56.018967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.018948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.023138 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.023110    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-18f84c7f\"/\"openshift-service-ca.crt\""
Jul 20 19:32:56.023278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.023144    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-18f84c7f\"/\"e2e-lifecycle-model-18f84c7f-kserve-self-signed-certs\""
Jul 20 19:32:56.023278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.023152    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-18f84c7f\"/\"default-dockercfg-gnnsj\""
Jul 20 19:32:56.023406 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.023157    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-18f84c7f\"/\"kube-root-ca.crt\""
Jul 20 19:32:56.031069 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.031042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:32:56.088517 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.088707 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.088707 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.088869 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.088869 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvpbb\" (UniqueName: \"kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.088869 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.088825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.189931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.189980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvpbb\" (UniqueName: \"kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190252 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190565 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.190635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.190581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.192295 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.192268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.192546 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.192532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.199664 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.199644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvpbb\" (UniqueName: \"kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb\") pod \"e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") " pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.329739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.329702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:32:56.477226 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.477202    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:32:56.483814 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:32:56.483733    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d7afda7_3ebb_46da_9cbb_4b2ae79f9651.slice/crio-c9b8b7afdf5b025f830387290e4f07883c394c2493704ab47603685061db1f6b WatchSource:0}: Error finding container c9b8b7afdf5b025f830387290e4f07883c394c2493704ab47603685061db1f6b: Status 404 returned error can't find the container with id c9b8b7afdf5b025f830387290e4f07883c394c2493704ab47603685061db1f6b
Jul 20 19:32:56.912878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.912838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" event={"ID":"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651","Type":"ContainerStarted","Data":"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"}
Jul 20 19:32:56.912878 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.912885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" event={"ID":"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651","Type":"ContainerStarted","Data":"c9b8b7afdf5b025f830387290e4f07883c394c2493704ab47603685061db1f6b"}
Jul 20 19:32:56.935744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:56.935685    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" podStartSLOduration=1.935669739 podStartE2EDuration="1.935669739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:32:56.932842558 +0000 UTC m=+1937.114365748" watchObservedRunningTime="2026-07-20 19:32:56.935669739 +0000 UTC m=+1937.117192928"
Jul 20 19:32:58.925075 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.924991    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerID="a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295" exitCode=0
Jul 20 19:32:58.925075 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.925035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerDied","Data":"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"}
Jul 20 19:32:58.925522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.925450    2563 scope.go:117] "RemoveContainer" containerID="a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"
Jul 20 19:32:58.926428 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.926400    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:58.926480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.926469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:58.926515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:58.926500    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:32:59.932171 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:32:59.932137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerStarted","Data":"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"}
Jul 20 19:33:00.435913 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:00.435882    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:33:00.437185 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:00.437163    2563 patch_prober.go:28] interesting pod/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 20 19:33:00.437234 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:00.437211    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 20 19:33:00.848730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:00.848701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:33:01.435336 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:01.435298    2563 patch_prober.go:28] interesting pod/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 20 19:33:01.435851 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:01.435363    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 20 19:33:02.435307 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:02.435276    2563 patch_prober.go:28] interesting pod/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 20 19:33:02.435469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:02.435329    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 20 19:33:03.435454 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:03.435419    2563 patch_prober.go:28] interesting pod/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 20 19:33:03.435864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:03.435476    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 20 19:33:04.439373 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:04.439342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:33:04.440286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:04.440267    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:33:06.329914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:06.329880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:33:06.330302 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:06.329964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:33:06.342149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:06.342127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:33:06.981960 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:06.981933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:33:47.162312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:33:47.162273    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:34:02.182920 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.182862    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" podUID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" containerName="main" containerID="cri-o://b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0" gracePeriod=45
Jul 20 19:34:02.438807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.438734    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:34:02.495477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvpbb\" (UniqueName: \"kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.495477 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.495702 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.495702 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.495838 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:02.495900 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495847    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home" (OuterVolumeSpecName: "home") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:02.495900 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.495894    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-model-cache\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:02.497864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.497831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:34:02.497864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.497834    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb" (OuterVolumeSpecName: "kube-api-access-zvpbb") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "kube-api-access-zvpbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:34:02.596450 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596424    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.596450 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir\") pod \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\" (UID: \"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651\") "
Jul 20 19:34:02.596729 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596712    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvpbb\" (UniqueName: \"kubernetes.io/projected/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-kube-api-access-zvpbb\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:02.596791 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596736    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-home\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:02.596791 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596751    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tls-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:02.596859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.596791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:02.598255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.598240    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm" (OuterVolumeSpecName: "dshm") pod "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" (UID: "5d7afda7-3ebb-46da-9cbb-4b2ae79f9651"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:02.697807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.697715    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-dshm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:02.697807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:02.697737    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651-tmp-dir\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:03.286432 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.286399    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" containerID="b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0" exitCode=0
Jul 20 19:34:03.286894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.286441    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"
Jul 20 19:34:03.286894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.286454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" event={"ID":"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651","Type":"ContainerDied","Data":"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"}
Jul 20 19:34:03.286894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.286485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z" event={"ID":"5d7afda7-3ebb-46da-9cbb-4b2ae79f9651","Type":"ContainerDied","Data":"c9b8b7afdf5b025f830387290e4f07883c394c2493704ab47603685061db1f6b"}
Jul 20 19:34:03.286894 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.286500    2563 scope.go:117] "RemoveContainer" containerID="b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"
Jul 20 19:34:03.295423 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.295405    2563 scope.go:117] "RemoveContainer" containerID="b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"
Jul 20 19:34:03.295680 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:34:03.295659    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0\": container with ID starting with b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0 not found: ID does not exist" containerID="b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"
Jul 20 19:34:03.295729 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.295689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0"} err="failed to get container status \"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0\": rpc error: code = NotFound desc = could not find container \"b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0\": container with ID starting with b17fc206ba11b984c21b0dd762381cffcc758c5e24e84dd514c934b4d17a06d0 not found: ID does not exist"
Jul 20 19:34:03.311237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.311213    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:34:03.315051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:03.315031    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-18f84c7f/e2e-lifecycle-model-18f84c7f-kserve-6cf468774c-65b8z"]
Jul 20 19:34:04.428714 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:04.428681    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" path="/var/lib/kubelet/pods/5d7afda7-3ebb-46da-9cbb-4b2ae79f9651/volumes"
Jul 20 19:34:36.172433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:36.172395    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:34:36.173021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:36.172667    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy" containerID="cri-o://07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335" gracePeriod=30
Jul 20 19:34:41.445332 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.445246    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:34:41.496598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.496556    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerID="07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335" exitCode=0
Jul 20 19:34:41.496796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.496627    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"
Jul 20 19:34:41.496796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.496636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerDied","Data":"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"}
Jul 20 19:34:41.496796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.496701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl" event={"ID":"9b243d86-e7a1-48f9-8f0a-f2738c73366d","Type":"ContainerDied","Data":"9111b988f1dfbc3aa0d708cf4f2f44129a4b0ef9d79e4ad03755eeb4e9e58f89"}
Jul 20 19:34:41.496796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.496737    2563 scope.go:117] "RemoveContainer" containerID="07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"
Jul 20 19:34:41.507287 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.507269    2563 scope.go:117] "RemoveContainer" containerID="a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"
Jul 20 19:34:41.515556 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.515539    2563 scope.go:117] "RemoveContainer" containerID="07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"
Jul 20 19:34:41.515896 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:34:41.515877    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335\": container with ID starting with 07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335 not found: ID does not exist" containerID="07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"
Jul 20 19:34:41.515990 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.515911    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335"} err="failed to get container status \"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335\": rpc error: code = NotFound desc = could not find container \"07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335\": container with ID starting with 07c53ad38a327079f45b845dde5ae3bb60e9601b7fca1c980d4dd80e02427335 not found: ID does not exist"
Jul 20 19:34:41.515990 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.515936    2563 scope.go:117] "RemoveContainer" containerID="a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"
Jul 20 19:34:41.516181 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:34:41.516160    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295\": container with ID starting with a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295 not found: ID does not exist" containerID="a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"
Jul 20 19:34:41.516227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.516189    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295"} err="failed to get container status \"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295\": rpc error: code = NotFound desc = could not find container \"a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295\": container with ID starting with a33ac445dd2548a65384dd00a1051097ace55e94167062d45938714876fef295 not found: ID does not exist"
Jul 20 19:34:41.538516 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538537    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hq8r\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.538809 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.539031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data\") pod \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\" (UID: \"9b243d86-e7a1-48f9-8f0a-f2738c73366d\") "
Jul 20 19:34:41.539031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538979    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:34:41.539031 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.538993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:41.539183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.539151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:41.539183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.539163    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.539183 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.539181    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.539340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.539296    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:41.540213 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.540169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:41.540814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.540794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:34:41.540929 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.540908    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:34:41.541090 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.541072    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r" (OuterVolumeSpecName: "kube-api-access-7hq8r") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "kube-api-access-7hq8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:34:41.541201 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.541186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b243d86-e7a1-48f9-8f0a-f2738c73366d" (UID: "9b243d86-e7a1-48f9-8f0a-f2738c73366d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:34:41.640327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640284    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hq8r\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-kube-api-access-7hq8r\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640320    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640329    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640341    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640350    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640358    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.640564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.640365    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b243d86-e7a1-48f9-8f0a-f2738c73366d-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:34:41.820925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.820894    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:34:41.831493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:41.831460    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-18f84c7f-openshift-default-768cc88f4c-wwjnl"]
Jul 20 19:34:42.428785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:34:42.428728    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" path="/var/lib/kubelet/pods/9b243d86-e7a1-48f9-8f0a-f2738c73366d/volumes"
Jul 20 19:35:32.304077 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.303990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:35:32.304712 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304577    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:32.304712 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304606    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:32.304712 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304626    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" containerName="main"
Jul 20 19:35:32.304712 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304635    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" containerName="main"
Jul 20 19:35:32.304968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304736    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:32.304968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304749    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7afda7-3ebb-46da-9cbb-4b2ae79f9651" containerName="main"
Jul 20 19:35:32.304968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.304775    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:32.307949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.307928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.312645 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.312622    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-bd0ca5-openshift-default-dockercfg-gvpsf\""
Jul 20 19:35:32.350023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.349976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:35:32.398695 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398695 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x2l7\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.398965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.398937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.499934 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.499899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500139 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.499946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500139 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.499974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500139 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x2l7\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500828 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.500949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.501016 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.500994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.501059 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.501028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.502793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.502768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.502926 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.502776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.510820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.510798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x2l7\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.510963 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.510869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token\") pod \"e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") " pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.617856 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.617747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:32.763107 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:35:32.763069    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60562c96_4eb5_4716_9753_6909cd3ec94b.slice/crio-ad76bfd4b72fcc98ec3ec7d718f93dc2083fd2f3e453a11bfff702cf220bc35e WatchSource:0}: Error finding container ad76bfd4b72fcc98ec3ec7d718f93dc2083fd2f3e453a11bfff702cf220bc35e: Status 404 returned error can't find the container with id ad76bfd4b72fcc98ec3ec7d718f93dc2083fd2f3e453a11bfff702cf220bc35e
Jul 20 19:35:32.763523 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.763455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:35:32.765344 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.765305    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:32.765431 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.765396    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:32.765469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.765445    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:32.793208 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:32.793179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerStarted","Data":"ad76bfd4b72fcc98ec3ec7d718f93dc2083fd2f3e453a11bfff702cf220bc35e"}
Jul 20 19:35:33.801073 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:33.801035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerStarted","Data":"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"}
Jul 20 19:35:33.825961 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:33.825916    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podStartSLOduration=1.825901827 podStartE2EDuration="1.825901827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:33.824462696 +0000 UTC m=+2094.005985908" watchObservedRunningTime="2026-07-20 19:35:33.825901827 +0000 UTC m=+2094.007425083"
Jul 20 19:35:34.618260 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:34.618224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:34.623330 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:34.623305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:34.807002 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:34.806961    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:34.807962 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:34.807940    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:40.471542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:40.471514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:35:40.481910 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:40.481890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:35:41.027481 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.027445    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:35:41.028023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.028004    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:41.028023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.028024    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b243d86-e7a1-48f9-8f0a-f2738c73366d" containerName="istio-proxy"
Jul 20 19:35:41.032766 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.032733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.035563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.035536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d43dd5-openshift-default-dockercfg-jrwnf\""
Jul 20 19:35:41.044085 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.044059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:35:41.073823 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.073785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.073823 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.073821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.073904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.073940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.073980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.074004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074066 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.074030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074251 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.074111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.074251 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.074141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbz6\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.174942 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.174972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbz6\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175310    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175486 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175641 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.175804 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.175786    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.177486 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.177460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.177748 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.177727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.185647 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.185401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.185647 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.185607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbz6\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6\") pod \"e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") " pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.344255 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.344171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:41.520665 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.520626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:35:41.521608 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:35:41.521569    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafba0a0b_0829_45a6_900f_652bb6635eb3.slice/crio-dcd8245b2df9c87b94ad016cd602dc98aa1e6092d71cedc2f6263c0b34032ee9 WatchSource:0}: Error finding container dcd8245b2df9c87b94ad016cd602dc98aa1e6092d71cedc2f6263c0b34032ee9: Status 404 returned error can't find the container with id dcd8245b2df9c87b94ad016cd602dc98aa1e6092d71cedc2f6263c0b34032ee9
Jul 20 19:35:41.523958 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.523923    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:41.524058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.523997    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:41.524058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.524027    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:41.851249 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.851213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerStarted","Data":"3ccb5bf73cb81b73a135887a34b52e0489f223621298bc644c94fe9820af4a31"}
Jul 20 19:35:41.851553 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.851534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerStarted","Data":"dcd8245b2df9c87b94ad016cd602dc98aa1e6092d71cedc2f6263c0b34032ee9"}
Jul 20 19:35:41.876688 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:41.876623    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podStartSLOduration=0.876598298 podStartE2EDuration="876.598298ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:41.873294585 +0000 UTC m=+2102.054817778" watchObservedRunningTime="2026-07-20 19:35:41.876598298 +0000 UTC m=+2102.058121477"
Jul 20 19:35:42.344858 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:42.344825    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:42.352141 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:42.351865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:42.861469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:42.861430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:42.866146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:42.866112    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:48.901971 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.901936    2563 generic.go:356] "Generic (PLEG): container finished" podID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerID="d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b" exitCode=0
Jul 20 19:35:48.902398 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.902010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerDied","Data":"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"}
Jul 20 19:35:48.902453 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.902438    2563 scope.go:117] "RemoveContainer" containerID="d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"
Jul 20 19:35:48.903432 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.903409    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:48.903499 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.903486    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:48.903538 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:48.903518    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:49.807138 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:49.807088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:49.911744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:49.911699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerStarted","Data":"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"}
Jul 20 19:35:50.618968 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:50.618930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:50.619961 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:50.619938    2563 patch_prober.go:28] interesting pod/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 20 19:35:50.620034 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:50.619990    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 20 19:35:51.618622 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:51.618584    2563 patch_prober.go:28] interesting pod/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 20 19:35:51.619065 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:51.618646    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 20 19:35:52.619036 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:52.618999    2563 patch_prober.go:28] interesting pod/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 20 19:35:52.619447 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:52.619054    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 20 19:35:53.618201 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:53.618167    2563 patch_prober.go:28] interesting pod/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 20 19:35:53.618376 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:53.618221    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 20 19:35:54.622921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:54.622890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:54.623305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:54.623176    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:54.623813 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:54.623786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:35:55.946389 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.946354    2563 generic.go:356] "Generic (PLEG): container finished" podID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerID="3ccb5bf73cb81b73a135887a34b52e0489f223621298bc644c94fe9820af4a31" exitCode=0
Jul 20 19:35:55.946955 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.946427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerDied","Data":"3ccb5bf73cb81b73a135887a34b52e0489f223621298bc644c94fe9820af4a31"}
Jul 20 19:35:55.947049 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.946996    2563 scope.go:117] "RemoveContainer" containerID="3ccb5bf73cb81b73a135887a34b52e0489f223621298bc644c94fe9820af4a31"
Jul 20 19:35:55.948033 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.948003    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:55.948147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.948076    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:55.948147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:55.948108    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:35:56.957604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:56.957568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerStarted","Data":"d777d8da68afcebfd8be9678cde72ffee298b5d4b63fc571f0e7833782f6217f"}
Jul 20 19:35:57.345303 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:57.345258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:57.346449 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:57.346418    2563 patch_prober.go:28] interesting pod/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 20 19:35:57.346589 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:57.346483    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 20 19:35:57.861612 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:57.861578    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:35:58.345143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:58.345110    2563 patch_prober.go:28] interesting pod/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 20 19:35:58.345564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:58.345164    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 20 19:35:59.344693 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:59.344653    2563 patch_prober.go:28] interesting pod/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 20 19:35:59.344898 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:35:59.344714    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 20 19:36:00.344855 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:00.344813    2563 patch_prober.go:28] interesting pod/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 20 19:36:00.345345 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:00.344876    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 20 19:36:01.349644 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:01.349613    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:36:01.351039 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:01.351017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:36:04.529679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.529648    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:36:04.532114 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.532097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.535433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.535405    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bd0ca5\"/\"kube-root-ca.crt\""
Jul 20 19:36:04.535433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.535406    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bd0ca5\"/\"default-dockercfg-ms6tn\""
Jul 20 19:36:04.536651 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.536631    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-bd0ca5\"/\"test-model-bd0ca5-kserve-self-signed-certs\""
Jul 20 19:36:04.536807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.536792    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-bd0ca5\"/\"openshift-service-ca.crt\""
Jul 20 19:36:04.550900 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.550801    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:36:04.713608 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.713816 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.713816 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.713895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.713895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gshr8\" (UniqueName: \"kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.713957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.713911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815208 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815208 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gshr8\" (UniqueName: \"kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815208 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815662 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815713    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.815829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.815721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.817564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.817544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.817675 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.817658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.827511 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.827490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gshr8\" (UniqueName: \"kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8\") pod \"test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") " pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:04.842546 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:04.842521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:05.026176 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:05.026144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:36:05.028480 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:36:05.028456    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2c9b3a0_3303_43c5_9553_338baa2ecb4e.slice/crio-a6ca753c5564fa610d0ff48697a639ec5d89bbc4ea79ebc7f171a4b08a1ed61d WatchSource:0}: Error finding container a6ca753c5564fa610d0ff48697a639ec5d89bbc4ea79ebc7f171a4b08a1ed61d: Status 404 returned error can't find the container with id a6ca753c5564fa610d0ff48697a639ec5d89bbc4ea79ebc7f171a4b08a1ed61d
Jul 20 19:36:06.015583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:06.015547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" event={"ID":"b2c9b3a0-3303-43c5-9553-338baa2ecb4e","Type":"ContainerStarted","Data":"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"}
Jul 20 19:36:06.016016 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:06.015600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" event={"ID":"b2c9b3a0-3303-43c5-9553-338baa2ecb4e","Type":"ContainerStarted","Data":"a6ca753c5564fa610d0ff48697a639ec5d89bbc4ea79ebc7f171a4b08a1ed61d"}
Jul 20 19:36:06.037378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:06.037326    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" podStartSLOduration=2.037311701 podStartE2EDuration="2.037311701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:06.034873417 +0000 UTC m=+2126.216396607" watchObservedRunningTime="2026-07-20 19:36:06.037311701 +0000 UTC m=+2126.218834930"
Jul 20 19:36:14.843238 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:14.843204    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:14.843706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:14.843250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:14.860142 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:14.860115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:15.077118 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:15.077089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:36:36.219944 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.219857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:36:36.222622 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.222598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.226583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.226554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d43dd5\"/\"kube-root-ca.crt\""
Jul 20 19:36:36.226583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.226569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d43dd5\"/\"default-dockercfg-82tbg\""
Jul 20 19:36:36.226583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.226581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d43dd5\"/\"test-model-d43dd5-kserve-self-signed-certs\""
Jul 20 19:36:36.226787 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.226556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d43dd5\"/\"openshift-service-ca.crt\""
Jul 20 19:36:36.233540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.233520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:36:36.299143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.299304 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.299304 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqbq5\" (UniqueName: \"kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.299304 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.299304 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.299528 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.299328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400556 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400556 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.400861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.400702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqbq5\" (UniqueName: \"kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.401108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.401084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.401154 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.401121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.401243 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.401227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.402830 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.402810    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.403001 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.402984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.409822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.409801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqbq5\" (UniqueName: \"kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5\") pod \"test-model-d43dd5-kserve-bc4fc68fc-jbt8n\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") " pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.532749 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.532713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:36.666325 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:36.666296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:36:36.668075 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:36:36.668048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod159f4288_905a_4c55_8907_472b95d431c3.slice/crio-6a6805e2d82cda4c8af75fd025754850a372672904e2cd904e15d61fb54cdc3f WatchSource:0}: Error finding container 6a6805e2d82cda4c8af75fd025754850a372672904e2cd904e15d61fb54cdc3f: Status 404 returned error can't find the container with id 6a6805e2d82cda4c8af75fd025754850a372672904e2cd904e15d61fb54cdc3f
Jul 20 19:36:37.190021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:37.189980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" event={"ID":"159f4288-905a-4c55-8907-472b95d431c3","Type":"ContainerStarted","Data":"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"}
Jul 20 19:36:37.190188 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:37.190033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" event={"ID":"159f4288-905a-4c55-8907-472b95d431c3","Type":"ContainerStarted","Data":"6a6805e2d82cda4c8af75fd025754850a372672904e2cd904e15d61fb54cdc3f"}
Jul 20 19:36:37.207360 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:37.207309    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" podStartSLOduration=1.207293873 podStartE2EDuration="1.207293873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:36:37.206738106 +0000 UTC m=+2157.388261295" watchObservedRunningTime="2026-07-20 19:36:37.207293873 +0000 UTC m=+2157.388817062"
Jul 20 19:36:46.533844 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:46.533793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:46.533844 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:46.533853    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:46.545773 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:46.545739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:36:47.259713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:36:47.259681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:37:19.126639 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:19.126603    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:37:20.085594 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:20.085559    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:37:34.148105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.148052    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" podUID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" containerName="main" containerID="cri-o://49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6" gracePeriod=45
Jul 20 19:37:34.407264 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.407204    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:37:34.509509 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.509475    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" containerID="49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6" exitCode=0
Jul 20 19:37:34.509705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.509539    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"
Jul 20 19:37:34.509705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.509559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" event={"ID":"b2c9b3a0-3303-43c5-9553-338baa2ecb4e","Type":"ContainerDied","Data":"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"}
Jul 20 19:37:34.509705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.509612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7" event={"ID":"b2c9b3a0-3303-43c5-9553-338baa2ecb4e","Type":"ContainerDied","Data":"a6ca753c5564fa610d0ff48697a639ec5d89bbc4ea79ebc7f171a4b08a1ed61d"}
Jul 20 19:37:34.509705 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.509636    2563 scope.go:117] "RemoveContainer" containerID="49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"
Jul 20 19:37:34.518655 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.518638    2563 scope.go:117] "RemoveContainer" containerID="49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"
Jul 20 19:37:34.518931 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:37:34.518911    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6\": container with ID starting with 49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6 not found: ID does not exist" containerID="49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"
Jul 20 19:37:34.518998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.518941    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6"} err="failed to get container status \"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6\": rpc error: code = NotFound desc = could not find container \"49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6\": container with ID starting with 49ab31a20f4e57447fb532f85aaab53bbda74d06dcd94251540c95b693af34c6 not found: ID does not exist"
Jul 20 19:37:34.538230 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538209    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gshr8\" (UniqueName: \"kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538359 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538426 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538426 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm\") pod \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\" (UID: \"b2c9b3a0-3303-43c5-9553-338baa2ecb4e\") "
Jul 20 19:37:34.538628 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538604    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:34.538682 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:34.538776 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538731    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home" (OuterVolumeSpecName: "home") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:34.538936 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538916    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-model-cache\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.539011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538954    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tmp-dir\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.539011 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.538962    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-home\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.540367 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.540345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8" (OuterVolumeSpecName: "kube-api-access-gshr8") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "kube-api-access-gshr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:34.540472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.540450    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm" (OuterVolumeSpecName: "dshm") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:34.540520 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.540466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2c9b3a0-3303-43c5-9553-338baa2ecb4e" (UID: "b2c9b3a0-3303-43c5-9553-338baa2ecb4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:37:34.639620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.639592    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-tls-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.639620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.639616    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-dshm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.639620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.639625    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gshr8\" (UniqueName: \"kubernetes.io/projected/b2c9b3a0-3303-43c5-9553-338baa2ecb4e-kube-api-access-gshr8\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:34.832344 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.832310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:37:34.835859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:34.835832    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-bd0ca5/test-model-bd0ca5-kserve-5fffcdcbc5-v6dv7"]
Jul 20 19:37:35.105728 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.105615    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" podUID="159f4288-905a-4c55-8907-472b95d431c3" containerName="main" containerID="cri-o://fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a" gracePeriod=45
Jul 20 19:37:35.368827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.368745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:37:35.445909 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.445875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446064 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.445924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqbq5\" (UniqueName: \"kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446064 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.445954    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446064 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446010    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446064 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446051    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446262 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446098    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home\") pod \"159f4288-905a-4c55-8907-472b95d431c3\" (UID: \"159f4288-905a-4c55-8907-472b95d431c3\") "
Jul 20 19:37:35.446262 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446189    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:35.446370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446276    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:35.446430 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446391    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home" (OuterVolumeSpecName: "home") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:35.446472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446465    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-home\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:35.446515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446479    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-tmp-dir\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:35.446515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.446489    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-model-cache\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:35.448224 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.448203    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm" (OuterVolumeSpecName: "dshm") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:35.448348 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.448330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5" (OuterVolumeSpecName: "kube-api-access-mqbq5") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "kube-api-access-mqbq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:35.448410 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.448375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "159f4288-905a-4c55-8907-472b95d431c3" (UID: "159f4288-905a-4c55-8907-472b95d431c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:37:35.517920 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.517884    2563 generic.go:356] "Generic (PLEG): container finished" podID="159f4288-905a-4c55-8907-472b95d431c3" containerID="fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a" exitCode=0
Jul 20 19:37:35.518058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.517932    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"
Jul 20 19:37:35.518058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.517972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" event={"ID":"159f4288-905a-4c55-8907-472b95d431c3","Type":"ContainerDied","Data":"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"}
Jul 20 19:37:35.518058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.518015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n" event={"ID":"159f4288-905a-4c55-8907-472b95d431c3","Type":"ContainerDied","Data":"6a6805e2d82cda4c8af75fd025754850a372672904e2cd904e15d61fb54cdc3f"}
Jul 20 19:37:35.518058 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.518031    2563 scope.go:117] "RemoveContainer" containerID="fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"
Jul 20 19:37:35.527749 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.527734    2563 scope.go:117] "RemoveContainer" containerID="fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"
Jul 20 19:37:35.528039 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:37:35.528021    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a\": container with ID starting with fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a not found: ID does not exist" containerID="fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"
Jul 20 19:37:35.528097 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.528049    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a"} err="failed to get container status \"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a\": rpc error: code = NotFound desc = could not find container \"fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a\": container with ID starting with fbcb5acc7374b68158fc49f79d297567223705f8d8411418c0de2f02be81a09a not found: ID does not exist"
Jul 20 19:37:35.539008 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.538986    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:37:35.544245 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.544222    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d43dd5/test-model-d43dd5-kserve-bc4fc68fc-jbt8n"]
Jul 20 19:37:35.547316 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.547285    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqbq5\" (UniqueName: \"kubernetes.io/projected/159f4288-905a-4c55-8907-472b95d431c3-kube-api-access-mqbq5\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:35.547316 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.547307    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/159f4288-905a-4c55-8907-472b95d431c3-dshm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:35.547316 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:35.547318    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/159f4288-905a-4c55-8907-472b95d431c3-tls-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:36.427377 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:36.427345    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="159f4288-905a-4c55-8907-472b95d431c3" path="/var/lib/kubelet/pods/159f4288-905a-4c55-8907-472b95d431c3/volumes"
Jul 20 19:37:36.427768 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:36.427716    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" path="/var/lib/kubelet/pods/b2c9b3a0-3303-43c5-9553-338baa2ecb4e/volumes"
Jul 20 19:37:41.710514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:41.710472    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:37:41.710973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:41.710674    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy" containerID="cri-o://f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1" gracePeriod=30
Jul 20 19:37:42.085515 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085482    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"]
Jul 20 19:37:42.085899 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085886    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="159f4288-905a-4c55-8907-472b95d431c3" containerName="main"
Jul 20 19:37:42.085967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085901    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="159f4288-905a-4c55-8907-472b95d431c3" containerName="main"
Jul 20 19:37:42.085967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085921    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" containerName="main"
Jul 20 19:37:42.085967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" containerName="main"
Jul 20 19:37:42.086067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085982    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c9b3a0-3303-43c5-9553-338baa2ecb4e" containerName="main"
Jul 20 19:37:42.086067 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.085995    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="159f4288-905a-4c55-8907-472b95d431c3" containerName="main"
Jul 20 19:37:42.090555 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.090524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:42.093464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.093440    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:37:42.093684 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.093483    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:37:42.096596 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.096570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"]
Jul 20 19:37:42.212941 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.212897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp\" (UID: \"dbaee78e-4aa1-4e21-8d07-9c58341328bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:42.313765 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.313715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp\" (UID: \"dbaee78e-4aa1-4e21-8d07-9c58341328bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:42.314433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.314406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp\" (UID: \"dbaee78e-4aa1-4e21-8d07-9c58341328bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:42.403662 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.403576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:42.542143 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:37:42.542112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbaee78e_4aa1_4e21_8d07_9c58341328bd.slice/crio-e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946 WatchSource:0}: Error finding container e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946: Status 404 returned error can't find the container with id e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946
Jul 20 19:37:42.542259 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.542155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"]
Jul 20 19:37:42.561829 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:42.561799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp" event={"ID":"dbaee78e-4aa1-4e21-8d07-9c58341328bd","Type":"ContainerStarted","Data":"e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946"}
Jul 20 19:37:43.569475 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:43.569383    2563 generic.go:356] "Generic (PLEG): container finished" podID="dbaee78e-4aa1-4e21-8d07-9c58341328bd" containerID="902fce44ef49e653f6612f379cbda2c584ab36455e92d8bb245b4dd8a922a1c2" exitCode=0
Jul 20 19:37:43.569864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:43.569475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp" event={"ID":"dbaee78e-4aa1-4e21-8d07-9c58341328bd","Type":"ContainerDied","Data":"902fce44ef49e653f6612f379cbda2c584ab36455e92d8bb245b4dd8a922a1c2"}
Jul 20 19:37:44.706688 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:44.706660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:44.836811 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:44.836697    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca\") pod \"dbaee78e-4aa1-4e21-8d07-9c58341328bd\" (UID: \"dbaee78e-4aa1-4e21-8d07-9c58341328bd\") "
Jul 20 19:37:44.837069 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:44.837046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dbaee78e-4aa1-4e21-8d07-9c58341328bd" (UID: "dbaee78e-4aa1-4e21-8d07-9c58341328bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:37:44.938113 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:44.938076    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbaee78e-4aa1-4e21-8d07-9c58341328bd-maas-api-service-ca\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:45.581425 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:45.581397    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"
Jul 20 19:37:45.581587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:45.581458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp" event={"ID":"dbaee78e-4aa1-4e21-8d07-9c58341328bd","Type":"ContainerDied","Data":"e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946"}
Jul 20 19:37:45.581587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:45.581496    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4e8df6a81d1b9eb70fc9efd9e443e67b72b55461b4d85efb49e0852fde19946"
Jul 20 19:37:46.973737 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:46.973669    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:37:47.157452 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157420    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x2l7\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157509    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157579    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157633 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.157924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157848    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:47.157924 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157858    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy\") pod \"60562c96-4eb5-4716-9753-6909cd3ec94b\" (UID: \"60562c96-4eb5-4716-9753-6909cd3ec94b\") "
Jul 20 19:37:47.158176 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.157972    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:47.158258 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158200    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:37:47.158339 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:47.158399 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158334    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.158399 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158380    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.158399 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158395    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60562c96-4eb5-4716-9753-6909cd3ec94b-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.158546 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.158477    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data" (OuterVolumeSpecName: "istio-data") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:47.159965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.159931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:37:47.160094 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.160079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:37:47.160144 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.160124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7" (OuterVolumeSpecName: "kube-api-access-5x2l7") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "kube-api-access-5x2l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:47.160189 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.160166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token" (OuterVolumeSpecName: "istio-token") pod "60562c96-4eb5-4716-9753-6909cd3ec94b" (UID: "60562c96-4eb5-4716-9753-6909cd3ec94b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:47.259043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259019    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.259043 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259043    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x2l7\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-kube-api-access-5x2l7\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.259193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259055    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.259193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259063    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60562c96-4eb5-4716-9753-6909cd3ec94b-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.259193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259071    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.259193 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.259079    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60562c96-4eb5-4716-9753-6909cd3ec94b-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:37:47.594146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.594059    2563 generic.go:356] "Generic (PLEG): container finished" podID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerID="f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1" exitCode=0
Jul 20 19:37:47.594146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.594106    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"
Jul 20 19:37:47.594146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.594115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerDied","Data":"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"}
Jul 20 19:37:47.594373 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.594157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn" event={"ID":"60562c96-4eb5-4716-9753-6909cd3ec94b","Type":"ContainerDied","Data":"ad76bfd4b72fcc98ec3ec7d718f93dc2083fd2f3e453a11bfff702cf220bc35e"}
Jul 20 19:37:47.594373 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.594178    2563 scope.go:117] "RemoveContainer" containerID="f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"
Jul 20 19:37:47.603794 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.603776    2563 scope.go:117] "RemoveContainer" containerID="d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"
Jul 20 19:37:47.611706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.611690    2563 scope.go:117] "RemoveContainer" containerID="f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"
Jul 20 19:37:47.611954 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:37:47.611939    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1\": container with ID starting with f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1 not found: ID does not exist" containerID="f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"
Jul 20 19:37:47.611991 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.611963    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1"} err="failed to get container status \"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1\": rpc error: code = NotFound desc = could not find container \"f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1\": container with ID starting with f2a79ad860fc02269011eb3240002551af0e5fbefb26497d17a9fd1660bb50d1 not found: ID does not exist"
Jul 20 19:37:47.611991 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.611978    2563 scope.go:117] "RemoveContainer" containerID="d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"
Jul 20 19:37:47.612229 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:37:47.612211    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b\": container with ID starting with d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b not found: ID does not exist" containerID="d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"
Jul 20 19:37:47.612278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.612236    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b"} err="failed to get container status \"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b\": rpc error: code = NotFound desc = could not find container \"d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b\": container with ID starting with d3c29b4aaad848f1668abc1b33519b7fe047064ee2cbb938287182bdca51460b not found: ID does not exist"
Jul 20 19:37:47.616407 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.616386    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:37:47.619695 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:47.619678    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-bd0ca5-openshift-default-ccf6d69f-8xsxn"]
Jul 20 19:37:48.427820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:48.427785    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" path="/var/lib/kubelet/pods/60562c96-4eb5-4716-9753-6909cd3ec94b/volumes"
Jul 20 19:37:57.192543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:57.192507    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"]
Jul 20 19:37:57.195321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:57.195297    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d43dd5-j69zp"]
Jul 20 19:37:58.427427 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:37:58.427392    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbaee78e-4aa1-4e21-8d07-9c58341328bd" path="/var/lib/kubelet/pods/dbaee78e-4aa1-4e21-8d07-9c58341328bd/volumes"
Jul 20 19:38:03.486560 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:03.486354    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:38:03.487009 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:03.486649    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy" containerID="cri-o://d777d8da68afcebfd8be9678cde72ffee298b5d4b63fc571f0e7833782f6217f" gracePeriod=30
Jul 20 19:38:04.370544 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.370507    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:38:04.371150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371116    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:04.371150 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371139    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:04.371370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371185    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbaee78e-4aa1-4e21-8d07-9c58341328bd" containerName="revoke-keys"
Jul 20 19:38:04.371370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371194    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbaee78e-4aa1-4e21-8d07-9c58341328bd" containerName="revoke-keys"
Jul 20 19:38:04.371370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371284    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:04.371370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371293    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:04.371370 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.371303    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbaee78e-4aa1-4e21-8d07-9c58341328bd" containerName="revoke-keys"
Jul 20 19:38:04.376359 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.376338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.379013 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.378987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3e0d8c-openshift-default-dockercfg-988l6\""
Jul 20 19:38:04.386320 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.386294    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:38:04.396793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.396745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9glj\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.396993 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.396976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397330 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397387 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397434 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397434 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.397513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.397448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.498648 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9glj\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.498922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.499126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.499248    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.499298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499635 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.499324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.499954 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.499932    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.501070 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.501054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.501298 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.501279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.506957 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.506937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.507138 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.507117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9glj\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj\") pod \"e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") " pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.689270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.689169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:04.838247 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.838214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:38:04.839121 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:38:04.839088    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3117beff_2d2f_4c44_8a61_8399383f8d2b.slice/crio-259d2991447d0fbb86cbd800a6e583ef5f28f6470c62e84769e8f7799686a508 WatchSource:0}: Error finding container 259d2991447d0fbb86cbd800a6e583ef5f28f6470c62e84769e8f7799686a508: Status 404 returned error can't find the container with id 259d2991447d0fbb86cbd800a6e583ef5f28f6470c62e84769e8f7799686a508
Jul 20 19:38:04.841385 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.841344    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:04.841458 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.841441    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:04.841500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:04.841488    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:05.695476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:05.695440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerStarted","Data":"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"}
Jul 20 19:38:05.695979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:05.695492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerStarted","Data":"259d2991447d0fbb86cbd800a6e583ef5f28f6470c62e84769e8f7799686a508"}
Jul 20 19:38:05.719369 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:05.719318    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podStartSLOduration=1.7193005810000002 podStartE2EDuration="1.719300581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:05.718065181 +0000 UTC m=+2245.899588396" watchObservedRunningTime="2026-07-20 19:38:05.719300581 +0000 UTC m=+2245.900823769"
Jul 20 19:38:06.690349 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:06.690316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:06.696180 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:06.696153    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:06.701186 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:06.701159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:06.701954 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:06.701936    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:08.715047 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.715015    2563 generic.go:356] "Generic (PLEG): container finished" podID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerID="d777d8da68afcebfd8be9678cde72ffee298b5d4b63fc571f0e7833782f6217f" exitCode=0
Jul 20 19:38:08.715466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.715084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerDied","Data":"d777d8da68afcebfd8be9678cde72ffee298b5d4b63fc571f0e7833782f6217f"}
Jul 20 19:38:08.715466 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.715147    2563 scope.go:117] "RemoveContainer" containerID="3ccb5bf73cb81b73a135887a34b52e0489f223621298bc644c94fe9820af4a31"
Jul 20 19:38:08.753335 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.753266    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:38:08.842177 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842143    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842177 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwbz6\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842490    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842567 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842519    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket\") pod \"afba0a0b-0829-45a6-900f-652bb6635eb3\" (UID: \"afba0a0b-0829-45a6-900f-652bb6635eb3\") "
Jul 20 19:38:08.842740 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:08.842922 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842899    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.842998 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842946    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:08.843096 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.843074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:08.843158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.842982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:08.843216 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.843151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data" (OuterVolumeSpecName: "istio-data") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:08.844531 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.844498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:38:08.844641 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.844535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6" (OuterVolumeSpecName: "kube-api-access-jwbz6") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "kube-api-access-jwbz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:08.844793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.844771    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:38:08.844949 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.844929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "afba0a0b-0829-45a6-900f-652bb6635eb3" (UID: "afba0a0b-0829-45a6-900f-652bb6635eb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:08.944325 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944288    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944325 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944317    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944325 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944326    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944336    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwbz6\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-kube-api-access-jwbz6\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944345    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944353    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944360    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afba0a0b-0829-45a6-900f-652bb6635eb3-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:08.944557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:08.944368    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afba0a0b-0829-45a6-900f-652bb6635eb3-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:38:09.722071 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:09.722041    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"
Jul 20 19:38:09.722496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:09.722089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz" event={"ID":"afba0a0b-0829-45a6-900f-652bb6635eb3","Type":"ContainerDied","Data":"dcd8245b2df9c87b94ad016cd602dc98aa1e6092d71cedc2f6263c0b34032ee9"}
Jul 20 19:38:09.722496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:09.722159    2563 scope.go:117] "RemoveContainer" containerID="d777d8da68afcebfd8be9678cde72ffee298b5d4b63fc571f0e7833782f6217f"
Jul 20 19:38:09.746209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:09.746185    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:38:09.751543 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:09.751514    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d43dd5-openshift-default-67d6d9b467-q98xz"]
Jul 20 19:38:10.427871 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:10.427834    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" path="/var/lib/kubelet/pods/afba0a0b-0829-45a6-900f-652bb6635eb3/volumes"
Jul 20 19:38:12.940482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.940448    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:38:12.941125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941105    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:38:12.941125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941127    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:38:12.941285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941155    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:38:12.941285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941163    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:38:12.941285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941178    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:12.941285 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941186    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60562c96-4eb5-4716-9753-6909cd3ec94b" containerName="istio-proxy"
Jul 20 19:38:12.941479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.941288    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:38:12.945822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.945801    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.948499 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.948455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4cceca-openshift-default-dockercfg-vs9h4\""
Jul 20 19:38:12.957207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.957180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:38:12.981044 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981216 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981216 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981216 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981379 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981379 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981379 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981379 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:12.981583 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:12.981374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082578 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.082796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.083179 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.082845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.083237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.083192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.083237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.083212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.083470 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.083441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.083604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.083525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.084111 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.084082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.085124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.085103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.085293 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.085274    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.092020 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.091993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.092149 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.092046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4\") pod \"e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") " pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.258209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.258176    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:13.409211 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.409186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:38:13.410752 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:38:13.410724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee8e8620_dc6b_4958_a038_a837047fafbb.slice/crio-28738f707f064affd109aa11e01347da5a2e58c8df10e285a51617aeade1b91b WatchSource:0}: Error finding container 28738f707f064affd109aa11e01347da5a2e58c8df10e285a51617aeade1b91b: Status 404 returned error can't find the container with id 28738f707f064affd109aa11e01347da5a2e58c8df10e285a51617aeade1b91b
Jul 20 19:38:13.413026 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.412989    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:13.413111 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.413076    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:13.413146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.413125    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:13.754398 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.754360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerStarted","Data":"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"}
Jul 20 19:38:13.754594 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.754430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerStarted","Data":"28738f707f064affd109aa11e01347da5a2e58c8df10e285a51617aeade1b91b"}
Jul 20 19:38:13.776794 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:13.776721    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podStartSLOduration=1.776705543 podStartE2EDuration="1.776705543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:13.775334018 +0000 UTC m=+2253.956857205" watchObservedRunningTime="2026-07-20 19:38:13.776705543 +0000 UTC m=+2253.958228731"
Jul 20 19:38:14.258487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:14.258456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:14.263639 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:14.263615    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:14.763145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:14.763113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:14.763920 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:14.763901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:22.743946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:22.743903    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 19:38:22.744346 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:22.743966    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 19:38:24.822937 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.822903    2563 generic.go:356] "Generic (PLEG): container finished" podID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerID="b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6" exitCode=0
Jul 20 19:38:24.823358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.822979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerDied","Data":"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"}
Jul 20 19:38:24.823402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.823371    2563 scope.go:117] "RemoveContainer" containerID="b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"
Jul 20 19:38:24.824364 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.824336    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:24.824499 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.824416    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:24.824499 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:24.824465    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:25.830179 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:25.830144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerStarted","Data":"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"}
Jul 20 19:38:26.689808 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:26.689674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:26.690015 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:26.689821    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 20 19:38:26.690015 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:26.689864    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 20 19:38:27.690788 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:27.690372    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 20 19:38:27.690788 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:27.690438    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 20 19:38:28.690402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:28.690357    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 20 19:38:28.690712 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:28.690428    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 20 19:38:29.690444 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:29.690398    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 20 19:38:29.690965 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:29.690468    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 20 19:38:30.693549 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:30.693511    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:30.694051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:30.693883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:30.694773 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:30.694730    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:38:32.884145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.884070    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerID="f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2" exitCode=0
Jul 20 19:38:32.884145 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.884117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerDied","Data":"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"}
Jul 20 19:38:32.884566 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.884473    2563 scope.go:117] "RemoveContainer" containerID="f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"
Jul 20 19:38:32.885472 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.885445    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:32.885523 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.885513    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:32.885558 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:32.885545    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:38:33.891566 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:33.891530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerStarted","Data":"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"}
Jul 20 19:38:34.259113 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:34.259080    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:34.259501 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:34.259474    2563 patch_prober.go:28] interesting pod/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 20 19:38:34.259670 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:34.259645    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 20 19:38:35.259226 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:35.259176    2563 patch_prober.go:28] interesting pod/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 20 19:38:35.259739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:35.259257    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 20 19:38:36.258815 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:36.258747    2563 patch_prober.go:28] interesting pod/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 20 19:38:36.259037 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:36.258855    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 20 19:38:37.259475 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:37.259437    2563 patch_prober.go:28] interesting pod/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 20 19:38:37.260062 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:37.260031    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 20 19:38:38.262613 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:38.262583    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:38.263098 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:38.262985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:38.264242 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:38.264221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:38:55.932684 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:55.932651    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:38:55.933099 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:38:55.932922    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" containerID="cri-o://871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0" gracePeriod=30
Jul 20 19:39:00.696651 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:00.696603    2563 patch_prober.go:28] interesting pod/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 19:39:00.697147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:00.696682    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:39:01.187714 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.187689    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:39:01.240200 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240200 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240200 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240193    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240385    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:01.240500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9glj\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240706 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert\") pod \"3117beff-2d2f-4c44-8a61-8399383f8d2b\" (UID: \"3117beff-2d2f-4c44-8a61-8399383f8d2b\") "
Jul 20 19:39:01.240912 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:01.240969 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240927    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:01.241024 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240965    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.241024 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.240984    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.241125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.241033    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:39:01.241317 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.241298    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:01.242693 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.242648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:01.242848 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.242744    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:01.242931 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.242875    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj" (OuterVolumeSpecName: "kube-api-access-r9glj") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "kube-api-access-r9glj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:01.243069 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.243050    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3117beff-2d2f-4c44-8a61-8399383f8d2b" (UID: "3117beff-2d2f-4c44-8a61-8399383f8d2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:39:01.341946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341911    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.341946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341941    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.341946 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341954    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.342218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341967    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3117beff-2d2f-4c44-8a61-8399383f8d2b-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.342218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341982    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9glj\" (UniqueName: \"kubernetes.io/projected/3117beff-2d2f-4c44-8a61-8399383f8d2b-kube-api-access-r9glj\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.342218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.341992    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3117beff-2d2f-4c44-8a61-8399383f8d2b-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:01.342218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:01.342000    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3117beff-2d2f-4c44-8a61-8399383f8d2b-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:02.054565 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.054530    2563 generic.go:356] "Generic (PLEG): container finished" podID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerID="871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0" exitCode=0
Jul 20 19:39:02.055074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.054594    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"
Jul 20 19:39:02.055074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.054609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerDied","Data":"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"}
Jul 20 19:39:02.055074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.054665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd" event={"ID":"3117beff-2d2f-4c44-8a61-8399383f8d2b","Type":"ContainerDied","Data":"259d2991447d0fbb86cbd800a6e583ef5f28f6470c62e84769e8f7799686a508"}
Jul 20 19:39:02.055074 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.054689    2563 scope.go:117] "RemoveContainer" containerID="871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"
Jul 20 19:39:02.064471 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.064456    2563 scope.go:117] "RemoveContainer" containerID="b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"
Jul 20 19:39:02.072540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.072525    2563 scope.go:117] "RemoveContainer" containerID="871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"
Jul 20 19:39:02.072873 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:39:02.072854    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0\": container with ID starting with 871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0 not found: ID does not exist" containerID="871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"
Jul 20 19:39:02.072961 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.072886    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0"} err="failed to get container status \"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0\": rpc error: code = NotFound desc = could not find container \"871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0\": container with ID starting with 871b6739cee3edbc3638bcea1fcfee315b32ba0cafdccd48183ff6fc68b826a0 not found: ID does not exist"
Jul 20 19:39:02.072961 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.072911    2563 scope.go:117] "RemoveContainer" containerID="b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"
Jul 20 19:39:02.073166 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:39:02.073148    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6\": container with ID starting with b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6 not found: ID does not exist" containerID="b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"
Jul 20 19:39:02.073207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.073173    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6"} err="failed to get container status \"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6\": rpc error: code = NotFound desc = could not find container \"b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6\": container with ID starting with b2734653b88ea223ecf6c69a9e4f05222c112f26fd0f72cde3fea5e60b25d8e6 not found: ID does not exist"
Jul 20 19:39:02.077979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.077955    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:39:02.084136 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.084118    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3e0d8c-openshift-default-7cf69d769-glhkd"]
Jul 20 19:39:02.428668 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:02.428578    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" path="/var/lib/kubelet/pods/3117beff-2d2f-4c44-8a61-8399383f8d2b/volumes"
Jul 20 19:39:23.334641 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:23.334602    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:39:23.335118 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:23.334870    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy" containerID="cri-o://c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c" gracePeriod=30
Jul 20 19:39:24.277687 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.277654    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:39:24.278082 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278069    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.278125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278083    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.278125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278108    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.278125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278114    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.278218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278170    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.278218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278177    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="afba0a0b-0829-45a6-900f-652bb6635eb3" containerName="istio-proxy"
Jul 20 19:39:24.278218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.278184    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3117beff-2d2f-4c44-8a61-8399383f8d2b" containerName="istio-proxy"
Jul 20 19:39:24.281294 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.281270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.284037 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.284018    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-037874-openshift-default-dockercfg-p95cb\""
Jul 20 19:39:24.294854 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.294819    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:39:24.451822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.451749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452423 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452548 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452619 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452677 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69dc6\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452817 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452817 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.452890 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.452833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553513 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69dc6\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.553739 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554051 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.553863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.554213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554311 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.554232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554311 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.554219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554440 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.554420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.554652 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.554628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.556463 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.556422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.556792 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.556772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.562096 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.562068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69dc6\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.562215 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.562197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token\") pod \"e2e-shared-a-037874-openshift-default-b76c89987-nsdwz\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") " pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.594053 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.594029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:24.733277 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.733245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:39:24.735804 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:39:24.735747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26302650_6842_48ad_b791_98a953b26706.slice/crio-2b27360f9ab457cfd60c825cc0eb13de27f10b1314f601e9e4a449392910b197 WatchSource:0}: Error finding container 2b27360f9ab457cfd60c825cc0eb13de27f10b1314f601e9e4a449392910b197: Status 404 returned error can't find the container with id 2b27360f9ab457cfd60c825cc0eb13de27f10b1314f601e9e4a449392910b197
Jul 20 19:39:24.738382 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.738337    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:24.738487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.738441    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:24.738542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:24.738489    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:25.188288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:25.188246    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerStarted","Data":"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"}
Jul 20 19:39:25.188486 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:25.188307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerStarted","Data":"2b27360f9ab457cfd60c825cc0eb13de27f10b1314f601e9e4a449392910b197"}
Jul 20 19:39:25.221530 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:25.221478    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podStartSLOduration=1.221462022 podStartE2EDuration="1.221462022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:25.219650339 +0000 UTC m=+2325.401173530" watchObservedRunningTime="2026-07-20 19:39:25.221462022 +0000 UTC m=+2325.402985211"
Jul 20 19:39:25.594557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:25.594522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:25.599355 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:25.599333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:26.193925 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:26.193892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:26.194818 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:26.194793    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:28.599863 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.598421    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:39:28.693358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693534 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data\") pod \"ee8e8620-dc6b-4958-a038-a837047fafbb\" (UID: \"ee8e8620-dc6b-4958-a038-a837047fafbb\") "
Jul 20 19:39:28.693790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:28.693790 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.693717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:28.694057 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.694025    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.694057 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.694019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:39:28.694057 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.694045    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.694237 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.694214    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:28.694527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.694503    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:28.695561 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.695528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:39:28.695561 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.695556    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:28.695984 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.695965    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4" (OuterVolumeSpecName: "kube-api-access-2nvv4") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "kube-api-access-2nvv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:28.696045 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.695970    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee8e8620-dc6b-4958-a038-a837047fafbb" (UID: "ee8e8620-dc6b-4958-a038-a837047fafbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:39:28.794527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794486    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nvv4\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-kube-api-access-2nvv4\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794527 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794523    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee8e8620-dc6b-4958-a038-a837047fafbb-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794536    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794548    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794559    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794569    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:28.794725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:28.794579    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee8e8620-dc6b-4958-a038-a837047fafbb-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:39:29.215586 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.215549    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerID="c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c" exitCode=0
Jul 20 19:39:29.215801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.215611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"
Jul 20 19:39:29.215801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.215637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerDied","Data":"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"}
Jul 20 19:39:29.215801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.215717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9" event={"ID":"ee8e8620-dc6b-4958-a038-a837047fafbb","Type":"ContainerDied","Data":"28738f707f064affd109aa11e01347da5a2e58c8df10e285a51617aeade1b91b"}
Jul 20 19:39:29.215801 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.215742    2563 scope.go:117] "RemoveContainer" containerID="c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"
Jul 20 19:39:29.225627 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.225611    2563 scope.go:117] "RemoveContainer" containerID="f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"
Jul 20 19:39:29.234286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.234266    2563 scope.go:117] "RemoveContainer" containerID="c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"
Jul 20 19:39:29.234549 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:39:29.234529    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c\": container with ID starting with c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c not found: ID does not exist" containerID="c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"
Jul 20 19:39:29.234589 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.234558    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c"} err="failed to get container status \"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c\": rpc error: code = NotFound desc = could not find container \"c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c\": container with ID starting with c57275e88f0dc759f873c6ce68a0292e73ce5b67237ee193226202917a87222c not found: ID does not exist"
Jul 20 19:39:29.234589 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.234577    2563 scope.go:117] "RemoveContainer" containerID="f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"
Jul 20 19:39:29.234776 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:39:29.234747    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2\": container with ID starting with f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2 not found: ID does not exist" containerID="f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"
Jul 20 19:39:29.234821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.234779    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2"} err="failed to get container status \"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2\": rpc error: code = NotFound desc = could not find container \"f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2\": container with ID starting with f12ad245f6dd21985f04689a1f0d1cdc2d6e0a5168c0e58cdc7c9b67fa220ec2 not found: ID does not exist"
Jul 20 19:39:29.239301 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.239280    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:39:29.243241 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:29.243219    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4cceca-openshift-default-744c5bc4cf-4pbk9"]
Jul 20 19:39:30.427842 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:30.427812    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" path="/var/lib/kubelet/pods/ee8e8620-dc6b-4958-a038-a837047fafbb/volumes"
Jul 20 19:39:32.484843 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.484742    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:39:32.485395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.485344    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:39:32.485395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.485366    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:39:32.485395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.485385    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:39:32.485395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.485394    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:39:32.485602 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.485513    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:39:32.490327 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.490278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.493859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.493836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e35917-openshift-default-dockercfg-pgdwg\""
Jul 20 19:39:32.516012 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.515985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:39:32.531188 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531337 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4jm\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531469 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531552 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.531598 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.531583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632256 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4jm\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632503 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.632889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.632837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.633083 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.633062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.633161 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.633090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.634701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.634675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.634821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.634723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.640548 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.640524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.640833 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.640816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4jm\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm\") pod \"e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") " pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.801691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.801648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:32.945084 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.945059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:39:32.946880 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:39:32.946842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37963e6_22f2_4342_a8f2_2556242a0b05.slice/crio-a66d008fe1febcd2b0eaa067c5537d9ec0a66b84aef2d6d697d47e61d6fe02b8 WatchSource:0}: Error finding container a66d008fe1febcd2b0eaa067c5537d9ec0a66b84aef2d6d697d47e61d6fe02b8: Status 404 returned error can't find the container with id a66d008fe1febcd2b0eaa067c5537d9ec0a66b84aef2d6d697d47e61d6fe02b8
Jul 20 19:39:32.949278 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.949243    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:32.949394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.949318    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:32.949394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:32.949351    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:33.240374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:33.240284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerStarted","Data":"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"}
Jul 20 19:39:33.240374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:33.240341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerStarted","Data":"a66d008fe1febcd2b0eaa067c5537d9ec0a66b84aef2d6d697d47e61d6fe02b8"}
Jul 20 19:39:33.265350 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:33.265299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podStartSLOduration=1.265284737 podStartE2EDuration="1.265284737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:33.262128516 +0000 UTC m=+2333.443651724" watchObservedRunningTime="2026-07-20 19:39:33.265284737 +0000 UTC m=+2333.446807926"
Jul 20 19:39:33.802038 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:33.802001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:34.807992 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:34.807955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:35.252382 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:35.252349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:35.253267 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:35.253246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:42.235912 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:42.235869    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 19:39:42.236444 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:42.235944    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 19:39:43.307382 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.307350    2563 generic.go:356] "Generic (PLEG): container finished" podID="26302650-6842-48ad-b791-98a953b26706" containerID="02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc" exitCode=0
Jul 20 19:39:43.307821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.307428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerDied","Data":"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"}
Jul 20 19:39:43.307865 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.307822    2563 scope.go:117] "RemoveContainer" containerID="02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"
Jul 20 19:39:43.308797 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.308771    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:43.308862 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.308839    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:43.308900 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:43.308869    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:44.314577 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:44.314538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerStarted","Data":"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"}
Jul 20 19:39:44.594500 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:44.594389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:44.594904 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:44.594871    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 20 19:39:44.595052 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:44.594930    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 20 19:39:45.595542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:45.595501    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 20 19:39:45.596192 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:45.596156    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 20 19:39:46.594664 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:46.594612    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 20 19:39:46.594914 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:46.594707    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 20 19:39:47.595071 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:47.595021    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 20 19:39:47.595604 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:47.595099    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 20 19:39:48.599542 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:48.599512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:48.600025 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:48.600009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:48.600679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:48.600654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:39:50.759623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:50.757861    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:57212->10.133.0.72:15021: read: connection reset by peer" start-of-body=
Jul 20 19:39:50.759623 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:50.757950    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": read tcp 10.133.0.2:57212->10.133.0.72:15021: read: connection reset by peer"
Jul 20 19:39:51.357877 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.357846    2563 generic.go:356] "Generic (PLEG): container finished" podID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerID="cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68" exitCode=0
Jul 20 19:39:51.358078 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.357920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerDied","Data":"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"}
Jul 20 19:39:51.358366 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.358349    2563 scope.go:117] "RemoveContainer" containerID="cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"
Jul 20 19:39:51.359396 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.359369    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:51.359497 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.359448    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:51.359560 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:51.359493    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 19:39:52.368575 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:52.368526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerStarted","Data":"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"}
Jul 20 19:39:52.802660 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:52.802622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:52.802891 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:52.802868    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 20 19:39:52.802945 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:52.802919    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 20 19:39:53.802204 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:53.802168    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 20 19:39:53.802586 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:53.802231    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 20 19:39:54.802774 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:54.802718    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 20 19:39:54.803170 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:54.802800    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 20 19:39:55.802568 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:55.802527    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 20 19:39:55.802782 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:55.802598    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 20 19:39:56.806233 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:56.806202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:56.806649 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:56.806465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:39:56.807212 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:39:56.807195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:40:40.508013 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:40:40.507985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:40:40.519447 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:40:40.519424    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:42:50.995749 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:50.995704    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:42:50.996378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:50.996337    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee8e8620-dc6b-4958-a038-a837047fafbb" containerName="istio-proxy"
Jul 20 19:42:50.999435 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:50.999420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.002488 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.002468    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"kube-root-ca.crt\""
Jul 20 19:42:51.002613 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.002527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"openshift-service-ca.crt\""
Jul 20 19:42:51.003733 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.003715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"default-dockercfg-wcf7w\""
Jul 20 19:42:51.003967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.003952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-037874\"/\"sub-test-model-037874-kserve-self-signed-certs\""
Jul 20 19:42:51.009826 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.009803    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:42:51.063452 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks566\" (UniqueName: \"kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.063607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.063607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.063607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.063607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.063607 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.063599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164479 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks566\" (UniqueName: \"kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.164973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.164922    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.165108 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.165086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.166921 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.166901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.167081 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.167063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.173717 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.173692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks566\" (UniqueName: \"kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566\") pod \"sub-test-model-037874-kserve-5ffc6fbb77-44gs7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") " pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.309395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.309307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:42:51.450366 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:51.450337    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:42:51.452081 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:42:51.452047    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaabdcd3_0f2f_48c7_bdce_cbe982dd4ab7.slice/crio-f8f62d356203e7a259913567d098e37f8b11f595a59b9c06acee9e4a40e99bfb WatchSource:0}: Error finding container f8f62d356203e7a259913567d098e37f8b11f595a59b9c06acee9e4a40e99bfb: Status 404 returned error can't find the container with id f8f62d356203e7a259913567d098e37f8b11f595a59b9c06acee9e4a40e99bfb
Jul 20 19:42:52.376027 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:52.375992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" event={"ID":"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7","Type":"ContainerStarted","Data":"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"}
Jul 20 19:42:52.376400 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:52.376036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" event={"ID":"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7","Type":"ContainerStarted","Data":"f8f62d356203e7a259913567d098e37f8b11f595a59b9c06acee9e4a40e99bfb"}
Jul 20 19:42:52.395207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:42:52.395159    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" podStartSLOduration=2.395144588 podStartE2EDuration="2.395144588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:42:52.393385928 +0000 UTC m=+2532.574909110" watchObservedRunningTime="2026-07-20 19:42:52.395144588 +0000 UTC m=+2532.576667807"
Jul 20 19:43:01.309565 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:43:01.309529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:43:01.309976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:43:01.309580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:43:01.321884 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:43:01.321861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:43:01.435736 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:43:01.435703    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:43:47.700514 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:43:47.700478    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:44:02.720185 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:02.720096    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" podUID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" containerName="main" containerID="cri-o://d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe" gracePeriod=45
Jul 20 19:44:02.970842 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:02.970777    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:44:03.139138 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139307 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139307 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139386 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks566\" (UniqueName: \"kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139386 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs\") pod \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\" (UID: \"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7\") "
Jul 20 19:44:03.139496 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139445    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home" (OuterVolumeSpecName: "home") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:03.139603 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139523    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache" (OuterVolumeSpecName: "model-cache") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:03.139656 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139630    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:03.139750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139729    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-model-cache\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.139857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139785    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tmp-dir\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.139857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.139802    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-home\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.141416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.141390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm" (OuterVolumeSpecName: "dshm") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:03.141540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.141440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:44:03.141540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.141462    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566" (OuterVolumeSpecName: "kube-api-access-ks566") pod "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" (UID: "caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7"). InnerVolumeSpecName "kube-api-access-ks566". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:44:03.240357 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.240267    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks566\" (UniqueName: \"kubernetes.io/projected/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-kube-api-access-ks566\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.240357 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.240299    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-tls-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.240357 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.240309    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7-dshm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:44:03.800195 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.800161    2563 generic.go:356] "Generic (PLEG): container finished" podID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" containerID="d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe" exitCode=0
Jul 20 19:44:03.800657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.800208    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"
Jul 20 19:44:03.800657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.800227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" event={"ID":"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7","Type":"ContainerDied","Data":"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"}
Jul 20 19:44:03.800657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.800258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7" event={"ID":"caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7","Type":"ContainerDied","Data":"f8f62d356203e7a259913567d098e37f8b11f595a59b9c06acee9e4a40e99bfb"}
Jul 20 19:44:03.800657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.800284    2563 scope.go:117] "RemoveContainer" containerID="d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"
Jul 20 19:44:03.809953 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.809936    2563 scope.go:117] "RemoveContainer" containerID="d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"
Jul 20 19:44:03.810180 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:44:03.810164    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe\": container with ID starting with d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe not found: ID does not exist" containerID="d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"
Jul 20 19:44:03.810224 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.810188    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe"} err="failed to get container status \"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe\": rpc error: code = NotFound desc = could not find container \"d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe\": container with ID starting with d11d73e7fd43783975da84c13da23b508fb8b27c0a34206db8729a69cd14f2fe not found: ID does not exist"
Jul 20 19:44:03.824068 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.824041    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:44:03.830535 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:03.830513    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-037874/sub-test-model-037874-kserve-5ffc6fbb77-44gs7"]
Jul 20 19:44:04.427730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:04.427689    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" path="/var/lib/kubelet/pods/caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7/volumes"
Jul 20 19:44:17.814569 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.814533    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:44:17.814979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.814955    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" containerName="main"
Jul 20 19:44:17.814979 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.814969    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" containerName="main"
Jul 20 19:44:17.815054 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.815045    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabdcd3-0f2f-48c7-bdce-cbe982dd4ab7" containerName="main"
Jul 20 19:44:17.818175 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.818160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.822315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.822275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"default-dockercfg-ntdg8\""
Jul 20 19:44:17.822480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.822402    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"openshift-service-ca.crt\""
Jul 20 19:44:17.822480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.822397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"rate-test-model-e35917-kserve-self-signed-certs\""
Jul 20 19:44:17.822614 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.822505    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"kube-root-ca.crt\""
Jul 20 19:44:17.826951 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.826564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:44:17.870611 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdtxl\" (UniqueName: \"kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.870827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.870827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.870827 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.870973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.870973 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.870871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971498 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdtxl\" (UniqueName: \"kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.971701 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.971673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.972484 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.972211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.972484 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.972446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.972670 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.972487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.975028 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.975006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.975146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.975055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:17.980769 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:17.980740    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdtxl\" (UniqueName: \"kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl\") pod \"rate-test-model-e35917-kserve-79bb5b6dc-9g22b\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") " pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:18.129487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:18.129397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:18.265177 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:18.264912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:44:18.268651 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:44:18.268606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod966322ec_d0b9_4630_8a17_d906edb64065.slice/crio-da13e7b40578509d8ea595ba5fec500319cbc5e5d8f6efa7565f9a449b61503b WatchSource:0}: Error finding container da13e7b40578509d8ea595ba5fec500319cbc5e5d8f6efa7565f9a449b61503b: Status 404 returned error can't find the container with id da13e7b40578509d8ea595ba5fec500319cbc5e5d8f6efa7565f9a449b61503b
Jul 20 19:44:18.887301 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:18.887264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" event={"ID":"966322ec-d0b9-4630-8a17-d906edb64065","Type":"ContainerStarted","Data":"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"}
Jul 20 19:44:18.887808 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:18.887307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" event={"ID":"966322ec-d0b9-4630-8a17-d906edb64065","Type":"ContainerStarted","Data":"da13e7b40578509d8ea595ba5fec500319cbc5e5d8f6efa7565f9a449b61503b"}
Jul 20 19:44:18.910836 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:18.910791    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" podStartSLOduration=1.910777366 podStartE2EDuration="1.910777366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:44:18.908062208 +0000 UTC m=+2619.089585412" watchObservedRunningTime="2026-07-20 19:44:18.910777366 +0000 UTC m=+2619.092300555"
Jul 20 19:44:28.130163 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:28.130126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:28.130163 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:28.130170    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:28.142132 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:28.142105    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:28.951307 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:28.951275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:44:40.674214 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:44:40.674180    2563 scope.go:117] "RemoveContainer" containerID="902fce44ef49e653f6612f379cbda2c584ab36455e92d8bb245b4dd8a922a1c2"
Jul 20 19:45:07.215802 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:07.215562    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:45:14.242826 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.242791    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:14.246124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.246106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:14.248876 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.248860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vhxv8\""
Jul 20 19:45:14.253299 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.253275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:14.302690 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.302657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9r4q\" (UniqueName: \"kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q\") pod \"test-curl-7316-140203759747120\" (UID: \"4b24eca9-7c1e-48f7-a7ca-887b8517a9df\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:14.403707 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.403664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9r4q\" (UniqueName: \"kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q\") pod \"test-curl-7316-140203759747120\" (UID: \"4b24eca9-7c1e-48f7-a7ca-887b8517a9df\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:14.412888 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.412861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9r4q\" (UniqueName: \"kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q\") pod \"test-curl-7316-140203759747120\" (UID: \"4b24eca9-7c1e-48f7-a7ca-887b8517a9df\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:14.557239 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.557199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:14.693859 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.693829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:14.695259 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:45:14.695228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b24eca9_7c1e_48f7_a7ca_887b8517a9df.slice/crio-c480eb5f379c51325310c5d2b5e5b446d26feaa2896ddd528bb74ea426dc6538 WatchSource:0}: Error finding container c480eb5f379c51325310c5d2b5e5b446d26feaa2896ddd528bb74ea426dc6538: Status 404 returned error can't find the container with id c480eb5f379c51325310c5d2b5e5b446d26feaa2896ddd528bb74ea426dc6538
Jul 20 19:45:14.696564 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:14.696543    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:45:15.204459 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:15.204419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759747120" event={"ID":"4b24eca9-7c1e-48f7-a7ca-887b8517a9df","Type":"ContainerStarted","Data":"c480eb5f379c51325310c5d2b5e5b446d26feaa2896ddd528bb74ea426dc6538"}
Jul 20 19:45:16.211549 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:16.211512    2563 generic.go:356] "Generic (PLEG): container finished" podID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" containerID="6cef881ad12a5f965de2477df2daaafd0a272b80c5f4f3e40b9d5e285592cef3" exitCode=0
Jul 20 19:45:16.211939 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:16.211574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759747120" event={"ID":"4b24eca9-7c1e-48f7-a7ca-887b8517a9df","Type":"ContainerDied","Data":"6cef881ad12a5f965de2477df2daaafd0a272b80c5f4f3e40b9d5e285592cef3"}
Jul 20 19:45:17.370793 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.370746    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:17.408614 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.408583    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759747120_4b24eca9-7c1e-48f7-a7ca-887b8517a9df/test-curl-7316-140203759747120/0.log"
Jul 20 19:45:17.432023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.431997    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9r4q\" (UniqueName: \"kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q\") pod \"4b24eca9-7c1e-48f7-a7ca-887b8517a9df\" (UID: \"4b24eca9-7c1e-48f7-a7ca-887b8517a9df\") "
Jul 20 19:45:17.434286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.434260    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q" (OuterVolumeSpecName: "kube-api-access-f9r4q") pod "4b24eca9-7c1e-48f7-a7ca-887b8517a9df" (UID: "4b24eca9-7c1e-48f7-a7ca-887b8517a9df"). InnerVolumeSpecName "kube-api-access-f9r4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:17.434679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.434660    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:17.438373 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.438353    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:17.532927 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:17.532897    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9r4q\" (UniqueName: \"kubernetes.io/projected/4b24eca9-7c1e-48f7-a7ca-887b8517a9df-kube-api-access-f9r4q\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:18.225218 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:18.225188    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:18.225402 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:18.225228    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c480eb5f379c51325310c5d2b5e5b446d26feaa2896ddd528bb74ea426dc6538"
Jul 20 19:45:18.235221 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:18.235193    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7316-140203759747120\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:18.427686 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:18.427650    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" path="/var/lib/kubelet/pods/4b24eca9-7c1e-48f7-a7ca-887b8517a9df/volumes"
Jul 20 19:45:20.240352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.240317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:20.240781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.240742    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:20.240781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.240769    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:20.240874 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.240837    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b24eca9-7c1e-48f7-a7ca-887b8517a9df" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:20.244084 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.244069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:20.246798 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.246749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vhxv8\""
Jul 20 19:45:20.248737 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.248711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:20.356812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.356777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krsn2\" (UniqueName: \"kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2\") pod \"test-curl-7316-140203759666208\" (UID: \"9babee9f-7555-42d3-b27e-c4365ca8fd52\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:20.458176 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.458142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krsn2\" (UniqueName: \"kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2\") pod \"test-curl-7316-140203759666208\" (UID: \"9babee9f-7555-42d3-b27e-c4365ca8fd52\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:20.467531 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.467498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krsn2\" (UniqueName: \"kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2\") pod \"test-curl-7316-140203759666208\" (UID: \"9babee9f-7555-42d3-b27e-c4365ca8fd52\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:20.556368 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.556331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:20.695209 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:20.695179    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:20.696550 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:45:20.696527    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9babee9f_7555_42d3_b27e_c4365ca8fd52.slice/crio-0b4b95ec65331a68763f10dda4c0f840d54335cff4fd91a5096ef3548ff35b4c WatchSource:0}: Error finding container 0b4b95ec65331a68763f10dda4c0f840d54335cff4fd91a5096ef3548ff35b4c: Status 404 returned error can't find the container with id 0b4b95ec65331a68763f10dda4c0f840d54335cff4fd91a5096ef3548ff35b4c
Jul 20 19:45:21.243552 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:21.243454    2563 generic.go:356] "Generic (PLEG): container finished" podID="9babee9f-7555-42d3-b27e-c4365ca8fd52" containerID="d1a0f8e460d0a9536f13cef0456fe7c42d825c407fca0d0f189acfb70b44676a" exitCode=0
Jul 20 19:45:21.243552 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:21.243530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759666208" event={"ID":"9babee9f-7555-42d3-b27e-c4365ca8fd52","Type":"ContainerDied","Data":"d1a0f8e460d0a9536f13cef0456fe7c42d825c407fca0d0f189acfb70b44676a"}
Jul 20 19:45:21.244094 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:21.243568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759666208" event={"ID":"9babee9f-7555-42d3-b27e-c4365ca8fd52","Type":"ContainerStarted","Data":"0b4b95ec65331a68763f10dda4c0f840d54335cff4fd91a5096ef3548ff35b4c"}
Jul 20 19:45:22.237464 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.237410    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" podUID="966322ec-d0b9-4630-8a17-d906edb64065" containerName="main" containerID="cri-o://f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9" gracePeriod=45
Jul 20 19:45:22.387220 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.387190    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:22.428958 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.428898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759666208_9babee9f-7555-42d3-b27e-c4365ca8fd52/test-curl-7316-140203759666208/0.log"
Jul 20 19:45:22.468962 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.468926    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:22.477047 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.477019    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:22.477742 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.477723    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krsn2\" (UniqueName: \"kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2\") pod \"9babee9f-7555-42d3-b27e-c4365ca8fd52\" (UID: \"9babee9f-7555-42d3-b27e-c4365ca8fd52\") "
Jul 20 19:45:22.479770 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.479731    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2" (OuterVolumeSpecName: "kube-api-access-krsn2") pod "9babee9f-7555-42d3-b27e-c4365ca8fd52" (UID: "9babee9f-7555-42d3-b27e-c4365ca8fd52"). InnerVolumeSpecName "kube-api-access-krsn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:22.515171 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.515148    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:45:22.578595 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.578564    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krsn2\" (UniqueName: \"kubernetes.io/projected/9babee9f-7555-42d3-b27e-c4365ca8fd52-kube-api-access-krsn2\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.679484 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679443    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdtxl\" (UniqueName: \"kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.679721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.679721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.679721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.679721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.679721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache\") pod \"966322ec-d0b9-4630-8a17-d906edb64065\" (UID: \"966322ec-d0b9-4630-8a17-d906edb64065\") "
Jul 20 19:45:22.680021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679817    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home" (OuterVolumeSpecName: "home") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:22.680021 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.679961    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:22.680157 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.680124    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache" (OuterVolumeSpecName: "model-cache") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:22.680288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.680177    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-home\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.680288 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.680196    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-tmp-dir\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.681812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.681792    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm" (OuterVolumeSpecName: "dshm") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:22.681812 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.681800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:22.681947 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.681879    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl" (OuterVolumeSpecName: "kube-api-access-hdtxl") pod "966322ec-d0b9-4630-8a17-d906edb64065" (UID: "966322ec-d0b9-4630-8a17-d906edb64065"). InnerVolumeSpecName "kube-api-access-hdtxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:22.781657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.781568    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-model-cache\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.781657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.781598    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdtxl\" (UniqueName: \"kubernetes.io/projected/966322ec-d0b9-4630-8a17-d906edb64065-kube-api-access-hdtxl\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.781657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.781611    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/966322ec-d0b9-4630-8a17-d906edb64065-tls-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:22.781657 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:22.781620    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/966322ec-d0b9-4630-8a17-d906edb64065-dshm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:23.257704 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.257675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:23.257704 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.257697    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b4b95ec65331a68763f10dda4c0f840d54335cff4fd91a5096ef3548ff35b4c"
Jul 20 19:45:23.259161 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.259125    2563 generic.go:356] "Generic (PLEG): container finished" podID="966322ec-d0b9-4630-8a17-d906edb64065" containerID="f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9" exitCode=0
Jul 20 19:45:23.259321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.259165    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"
Jul 20 19:45:23.259321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.259217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" event={"ID":"966322ec-d0b9-4630-8a17-d906edb64065","Type":"ContainerDied","Data":"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"}
Jul 20 19:45:23.259321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.259244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b" event={"ID":"966322ec-d0b9-4630-8a17-d906edb64065","Type":"ContainerDied","Data":"da13e7b40578509d8ea595ba5fec500319cbc5e5d8f6efa7565f9a449b61503b"}
Jul 20 19:45:23.259321 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.259264    2563 scope.go:117] "RemoveContainer" containerID="f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"
Jul 20 19:45:23.269835 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.269817    2563 scope.go:117] "RemoveContainer" containerID="f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"
Jul 20 19:45:23.270080 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:23.270061    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9\": container with ID starting with f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9 not found: ID does not exist" containerID="f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"
Jul 20 19:45:23.270127 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.270088    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9"} err="failed to get container status \"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9\": rpc error: code = NotFound desc = could not find container \"f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9\": container with ID starting with f2d70d181c1701936bcaf26fd6de5705da13777b77fb16c2c92914a391d018e9 not found: ID does not exist"
Jul 20 19:45:23.270512 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:23.270490    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7316-140203759666208\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:23.285126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.285101    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:45:23.288821 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:23.288795    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7316-140203759666208\" is forbidden: User \"system:node:ip-10-0-135-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-117.ec2.internal' and this object" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:23.289374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:23.289356    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/rate-test-model-e35917-kserve-79bb5b6dc-9g22b"]
Jul 20 19:45:24.428430 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:24.428399    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966322ec-d0b9-4630-8a17-d906edb64065" path="/var/lib/kubelet/pods/966322ec-d0b9-4630-8a17-d906edb64065/volumes"
Jul 20 19:45:24.428820 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:24.428770    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" path="/var/lib/kubelet/pods/9babee9f-7555-42d3-b27e-c4365ca8fd52/volumes"
Jul 20 19:45:40.543864 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:40.543839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:45:40.560928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:40.560902    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:45:47.157026 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.156986    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:45:47.157476 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.157218    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" containerID="cri-o://53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432" gracePeriod=30
Jul 20 19:45:47.553774 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.553721    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"]
Jul 20 19:45:47.554378 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:47.554458 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554381    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:47.554458 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554401    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966322ec-d0b9-4630-8a17-d906edb64065" containerName="main"
Jul 20 19:45:47.554458 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554410    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="966322ec-d0b9-4630-8a17-d906edb64065" containerName="main"
Jul 20 19:45:47.554617 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554501    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="966322ec-d0b9-4630-8a17-d906edb64065" containerName="main"
Jul 20 19:45:47.554617 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.554516    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9babee9f-7555-42d3-b27e-c4365ca8fd52" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:47.560112 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.560091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:47.563315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.563184    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:45:47.563315 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.563186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:45:47.565263 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.565226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"]
Jul 20 19:45:47.599723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.599692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6\" (UID: \"323f7c86-8763-440e-95d6-234d88419b30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:47.701093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.701061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6\" (UID: \"323f7c86-8763-440e-95d6-234d88419b30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:47.701691 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.701671    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6\" (UID: \"323f7c86-8763-440e-95d6-234d88419b30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:47.872650 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:47.872562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:48.007771 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.007678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"]
Jul 20 19:45:48.011251 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:45:48.011215    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323f7c86_8763_440e_95d6_234d88419b30.slice/crio-f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c WatchSource:0}: Error finding container f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c: Status 404 returned error can't find the container with id f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c
Jul 20 19:45:48.410475 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.410440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6" event={"ID":"323f7c86-8763-440e-95d6-234d88419b30","Type":"ContainerStarted","Data":"33324e7c028fbbdd57e64cfd4c95e780ae613dbc24aa990267183372d04ceaa3"}
Jul 20 19:45:48.410910 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.410530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6" event={"ID":"323f7c86-8763-440e-95d6-234d88419b30","Type":"ContainerStarted","Data":"f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c"}
Jul 20 19:45:48.445019 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.444969    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6" podStartSLOduration=1.4449541510000001 podStartE2EDuration="1.444954151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:48.442665622 +0000 UTC m=+2708.624188811" watchObservedRunningTime="2026-07-20 19:45:48.444954151 +0000 UTC m=+2708.626477339"
Jul 20 19:45:48.602023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.601942    2563 patch_prober.go:28] interesting pod/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 19:45:48.602023 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:48.601998    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:45:49.417368 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:49.417334    2563 generic.go:356] "Generic (PLEG): container finished" podID="323f7c86-8763-440e-95d6-234d88419b30" containerID="33324e7c028fbbdd57e64cfd4c95e780ae613dbc24aa990267183372d04ceaa3" exitCode=0
Jul 20 19:45:49.417725 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:49.417419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6" event={"ID":"323f7c86-8763-440e-95d6-234d88419b30","Type":"ContainerDied","Data":"33324e7c028fbbdd57e64cfd4c95e780ae613dbc24aa990267183372d04ceaa3"}
Jul 20 19:45:50.552692 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:50.552663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:50.628682 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:50.628653    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca\") pod \"323f7c86-8763-440e-95d6-234d88419b30\" (UID: \"323f7c86-8763-440e-95d6-234d88419b30\") "
Jul 20 19:45:50.629015 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:50.628993    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "323f7c86-8763-440e-95d6-234d88419b30" (UID: "323f7c86-8763-440e-95d6-234d88419b30"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:50.729938 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:50.729842    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323f7c86-8763-440e-95d6-234d88419b30-maas-api-service-ca\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:51.431037 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:51.431006    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"
Jul 20 19:45:51.431207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:51.431043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6" event={"ID":"323f7c86-8763-440e-95d6-234d88419b30","Type":"ContainerDied","Data":"f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c"}
Jul 20 19:45:51.431207 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:51.431084    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a129623de3fb7b5b3063025d2cde05de0b5f9e7f75c88c74bfbcdf733d325c"
Jul 20 19:45:52.411158 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.411132    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:45:52.439395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.439290    2563 generic.go:356] "Generic (PLEG): container finished" podID="26302650-6842-48ad-b791-98a953b26706" containerID="53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432" exitCode=0
Jul 20 19:45:52.439395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.439380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerDied","Data":"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"}
Jul 20 19:45:52.439590 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.439420    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"
Jul 20 19:45:52.439590 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.439429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz" event={"ID":"26302650-6842-48ad-b791-98a953b26706","Type":"ContainerDied","Data":"2b27360f9ab457cfd60c825cc0eb13de27f10b1314f601e9e4a449392910b197"}
Jul 20 19:45:52.439590 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.439459    2563 scope.go:117] "RemoveContainer" containerID="53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"
Jul 20 19:45:52.443482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.443456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.443624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.443501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69dc6\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.443624 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.443535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.444125 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.444101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.444487 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.444459    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:52.444613 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.444594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.444822 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.444805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.445217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445194    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.445217 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.444916    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:52.445395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445108    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:52.445395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.445395 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445284    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data\") pod \"26302650-6842-48ad-b791-98a953b26706\" (UID: \"26302650-6842-48ad-b791-98a953b26706\") "
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445691    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445713    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.445725    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.446175    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token" (OuterVolumeSpecName: "istio-token") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.446186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6" (OuterVolumeSpecName: "kube-api-access-69dc6") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "kube-api-access-69dc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:52.446227 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.446208    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:52.446573 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.446560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data" (OuterVolumeSpecName: "istio-data") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:45:52.446923 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.446900    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:52.448010 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.447990    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26302650-6842-48ad-b791-98a953b26706" (UID: "26302650-6842-48ad-b791-98a953b26706"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:45:52.453421 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.453315    2563 scope.go:117] "RemoveContainer" containerID="02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"
Jul 20 19:45:52.465909 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.465891    2563 scope.go:117] "RemoveContainer" containerID="53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"
Jul 20 19:45:52.466236 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:52.466211    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432\": container with ID starting with 53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432 not found: ID does not exist" containerID="53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"
Jul 20 19:45:52.466340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.466240    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432"} err="failed to get container status \"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432\": rpc error: code = NotFound desc = could not find container \"53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432\": container with ID starting with 53462151aeddf2d03434eeea8553480ab91270c0039df89b19d3cef4bc9ab432 not found: ID does not exist"
Jul 20 19:45:52.466340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.466260    2563 scope.go:117] "RemoveContainer" containerID="02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"
Jul 20 19:45:52.466530 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:45:52.466513    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc\": container with ID starting with 02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc not found: ID does not exist" containerID="02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"
Jul 20 19:45:52.466576 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.466534    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc"} err="failed to get container status \"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc\": rpc error: code = NotFound desc = could not find container \"02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc\": container with ID starting with 02c7ceb8dae0cf6ad694ac474a905d1ff0b2aede7bc3d50d4d339d156feebbdc not found: ID does not exist"
Jul 20 19:45:52.547286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547251    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.547286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547286    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.547286 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547299    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69dc6\" (UniqueName: \"kubernetes.io/projected/26302650-6842-48ad-b791-98a953b26706-kube-api-access-69dc6\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.547533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547312    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26302650-6842-48ad-b791-98a953b26706-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.547533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547324    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26302650-6842-48ad-b791-98a953b26706-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.547533 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.547334    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26302650-6842-48ad-b791-98a953b26706-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:45:52.763396 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.763366    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:45:52.772895 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:52.772869    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-037874-openshift-default-b76c89987-nsdwz"]
Jul 20 19:45:54.428510 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:45:54.428476    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26302650-6842-48ad-b791-98a953b26706" path="/var/lib/kubelet/pods/26302650-6842-48ad-b791-98a953b26706/volumes"
Jul 20 19:46:02.644328 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:02.644283    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"]
Jul 20 19:46:02.646765 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:02.646735    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e35917-w6nc6"]
Jul 20 19:46:04.427988 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:04.427953    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323f7c86-8763-440e-95d6-234d88419b30" path="/var/lib/kubelet/pods/323f7c86-8763-440e-95d6-234d88419b30/volumes"
Jul 20 19:46:09.161365 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:09.161326    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:46:09.161853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:09.161604    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" containerID="cri-o://55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28" gracePeriod=30
Jul 20 19:46:09.848869 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:09.848837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdcb58dd6-4xxvd_e6d40cf6-849b-4f96-8915-42b4b6e14b53/authorino/0.log"
Jul 20 19:46:11.809298 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:11.809252    2563 patch_prober.go:28] interesting pod/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 19:46:11.809682 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:11.809330    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:46:14.411780 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.411743    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:46:14.542388 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542358    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff4jm\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542418    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542522 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542484    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542554    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542598    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data\") pod \"d37963e6-22f2-4342-a8f2-2556242a0b05\" (UID: \"d37963e6-22f2-4342-a8f2-2556242a0b05\") "
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542667    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:46:14.542821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542685    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:46:14.543124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.542883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:46:14.543124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.543015    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-certs\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.543124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.543034    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-workload-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.543124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.543049    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-credential-socket\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.543124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.543114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:46:14.543601 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.543577    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data" (OuterVolumeSpecName: "istio-data") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:46:14.544620 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.544596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm" (OuterVolumeSpecName: "kube-api-access-ff4jm") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "kube-api-access-ff4jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:46:14.544750 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.544679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 19:46:14.545003 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.544980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:46:14.545003 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.544991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token" (OuterVolumeSpecName: "istio-token") pod "d37963e6-22f2-4342-a8f2-2556242a0b05" (UID: "d37963e6-22f2-4342-a8f2-2556242a0b05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:46:14.564453 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.564429    2563 generic.go:356] "Generic (PLEG): container finished" podID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerID="55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28" exitCode=0
Jul 20 19:46:14.564563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.564471    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"
Jul 20 19:46:14.564563 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.564511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerDied","Data":"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"}
Jul 20 19:46:14.564663 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.564563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb" event={"ID":"d37963e6-22f2-4342-a8f2-2556242a0b05","Type":"ContainerDied","Data":"a66d008fe1febcd2b0eaa067c5537d9ec0a66b84aef2d6d697d47e61d6fe02b8"}
Jul 20 19:46:14.564663 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.564586    2563 scope.go:117] "RemoveContainer" containerID="55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"
Jul 20 19:46:14.573681 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.573663    2563 scope.go:117] "RemoveContainer" containerID="cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"
Jul 20 19:46:14.581765 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.581736    2563 scope.go:117] "RemoveContainer" containerID="55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"
Jul 20 19:46:14.582091 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:46:14.582072    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28\": container with ID starting with 55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28 not found: ID does not exist" containerID="55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"
Jul 20 19:46:14.582161 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.582100    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28"} err="failed to get container status \"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28\": rpc error: code = NotFound desc = could not find container \"55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28\": container with ID starting with 55a50688b4f5dc5b23ab707e198f3da3f3821951c96285a438142910c6abab28 not found: ID does not exist"
Jul 20 19:46:14.582161 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.582121    2563 scope.go:117] "RemoveContainer" containerID="cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"
Jul 20 19:46:14.582366 ip-10-0-135-117 kubenswrapper[2563]: E0720 19:46:14.582350    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68\": container with ID starting with cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68 not found: ID does not exist" containerID="cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"
Jul 20 19:46:14.582404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.582373    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68"} err="failed to get container status \"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68\": rpc error: code = NotFound desc = could not find container \"cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68\": container with ID starting with cc7e07469795c5946035dab3f1a2ecb27e31dc20664eec953325655b28de0f68 not found: ID does not exist"
Jul 20 19:46:14.588404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.588383    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:46:14.591480 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.591460    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e35917-openshift-default-6579b79bf9-zdjdb"]
Jul 20 19:46:14.643806 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643780    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff4jm\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-kube-api-access-ff4jm\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.643806 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643800    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-podinfo\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.643928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643810    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-envoy\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.643928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643820    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-token\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.643928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643828    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37963e6-22f2-4342-a8f2-2556242a0b05-istiod-ca-cert\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:14.643928 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:14.643835    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37963e6-22f2-4342-a8f2-2556242a0b05-istio-data\") on node \"ip-10-0-135-117.ec2.internal\" DevicePath \"\""
Jul 20 19:46:15.526414 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:15.526388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v8flf_53bcd4b8-0749-40e1-9d0b-f9fb064da415/manager/0.log"
Jul 20 19:46:15.664699 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:15.664663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5lrvq_d42812ee-7b77-49d5-a3d0-dfcdb41fe790/manager/0.log"
Jul 20 19:46:15.799741 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:15.799660    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55476c59db-lw2dr_a990562a-c5b5-4469-89f6-e8085faf2ce7/manager/0.log"
Jul 20 19:46:15.921740 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:15.921710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-58p4w_cb5c8a6e-7ad9-4755-8797-d31de46d3e70/server/0.log"
Jul 20 19:46:16.060912 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:16.060825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4p8rq_c08ef001-a82d-4282-8068-950cdd25c4d7/manager/0.log"
Jul 20 19:46:16.193721 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:16.193690    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-d9nqq_dc53a6f7-92fd-47be-ae45-594e3c3b6a0b/manager/0.log"
Jul 20 19:46:16.208104 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:16.208083    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-d9nqq_dc53a6f7-92fd-47be-ae45-594e3c3b6a0b/copy-manifests/0.log"
Jul 20 19:46:16.427493 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:16.427415    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" path="/var/lib/kubelet/pods/d37963e6-22f2-4342-a8f2-2556242a0b05/volumes"
Jul 20 19:46:16.938385 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:16.938356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742915-7g55x_816ba813-4cd6-49d1-9711-900452f3480c/cleanup/0.log"
Jul 20 19:46:18.123660 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.123633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/extract/0.log"
Jul 20 19:46:18.129853 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.129827    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/util/0.log"
Jul 20 19:46:18.135870 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.135852    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/pull/0.log"
Jul 20 19:46:18.251636 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.251601    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/pull/0.log"
Jul 20 19:46:18.258055 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.258034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/extract/0.log"
Jul 20 19:46:18.264307 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.264287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/util/0.log"
Jul 20 19:46:18.379976 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.379922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/extract/0.log"
Jul 20 19:46:18.386219 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.386192    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/util/0.log"
Jul 20 19:46:18.392981 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.392961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/pull/0.log"
Jul 20 19:46:18.530470 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.530443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/util/0.log"
Jul 20 19:46:18.536508 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.536484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/pull/0.log"
Jul 20 19:46:18.542587 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.542569    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/extract/0.log"
Jul 20 19:46:18.666828 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.666743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdcb58dd6-4xxvd_e6d40cf6-849b-4f96-8915-42b4b6e14b53/authorino/0.log"
Jul 20 19:46:18.801868 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.801839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mtvgj_35163c8d-52be-47ab-b29b-d697a487dae4/manager/0.log"
Jul 20 19:46:18.925358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:18.925283    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-76zwb_458a99d6-2a51-49dd-b718-00379971e243/manager/0.log"
Jul 20 19:46:19.161730 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:19.161700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ld6xl_3135ac5c-260e-484f-9a0a-c9f4a9288d32/registry-server/0.log"
Jul 20 19:46:19.283889 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:19.283856    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xfk8h_632a2e01-3066-4a74-a826-f710b8a229ea/manager/0.log"
Jul 20 19:46:19.525882 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:19.525844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zdcr7_b7427d9a-543d-4b36-9f06-7c4a5c76585d/manager/0.log"
Jul 20 19:46:19.903124 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:19.903092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf445pz6_849fdb7c-4857-4e13-84ec-e76b7c7c2148/istio-proxy/0.log"
Jul 20 19:46:20.272723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:20.272693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-zzv96_a6a779f7-0628-4107-9903-a2483691c07b/kube-auth-proxy/0.log"
Jul 20 19:46:20.401528 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:20.401493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/1.log"
Jul 20 19:46:20.531305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:20.531226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8krcx_a9fcdd8b-0534-4f90-b984-959e267d2b06/payload-pre-processing/0.log"
Jul 20 19:46:21.266329 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:21.266296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gfssk_16c6a5b3-f61e-4720-9d60-6cf82656a389/main/0.log"
Jul 20 19:46:27.638156 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638116    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxb5l/must-gather-hjpll"]
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638477    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638487    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638498    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638504    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638511    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638527    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323f7c86-8763-440e-95d6-234d88419b30" containerName="revoke-keys"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638532    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="323f7c86-8763-440e-95d6-234d88419b30" containerName="revoke-keys"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638542    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638548    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638611    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="323f7c86-8763-440e-95d6-234d88419b30" containerName="revoke-keys"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638618    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638624    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638629    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37963e6-22f2-4342-a8f2-2556242a0b05" containerName="istio-proxy"
Jul 20 19:46:27.638744 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.638739    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="26302650-6842-48ad-b791-98a953b26706" containerName="istio-proxy"
Jul 20 19:46:27.641896 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.641872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.644766 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.644729    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"kube-root-ca.crt\""
Jul 20 19:46:27.644893 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.644729    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxb5l\"/\"default-dockercfg-5rgks\""
Jul 20 19:46:27.645728 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.645712    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"openshift-service-ca.crt\""
Jul 20 19:46:27.650270 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.650043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/must-gather-hjpll"]
Jul 20 19:46:27.663621 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.663591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr79h\" (UniqueName: \"kubernetes.io/projected/57254a88-3219-4784-86fa-a42d134ae11c-kube-api-access-mr79h\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.663784 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.663641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57254a88-3219-4784-86fa-a42d134ae11c-must-gather-output\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.764551 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.764516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57254a88-3219-4784-86fa-a42d134ae11c-must-gather-output\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.764723 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.764615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr79h\" (UniqueName: \"kubernetes.io/projected/57254a88-3219-4784-86fa-a42d134ae11c-kube-api-access-mr79h\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.764960 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.764930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57254a88-3219-4784-86fa-a42d134ae11c-must-gather-output\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.775413 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.775382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr79h\" (UniqueName: \"kubernetes.io/projected/57254a88-3219-4784-86fa-a42d134ae11c-kube-api-access-mr79h\") pod \"must-gather-hjpll\" (UID: \"57254a88-3219-4784-86fa-a42d134ae11c\") " pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:27.952967 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:27.952883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/must-gather-hjpll"
Jul 20 19:46:28.087861 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:28.087833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/must-gather-hjpll"]
Jul 20 19:46:28.089465 ip-10-0-135-117 kubenswrapper[2563]: W0720 19:46:28.089432    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57254a88_3219_4784_86fa_a42d134ae11c.slice/crio-5c60ae1f31fdf9cd2bba0d63e331065961091cdcb5a0088b56f661fa48141ca1 WatchSource:0}: Error finding container 5c60ae1f31fdf9cd2bba0d63e331065961091cdcb5a0088b56f661fa48141ca1: Status 404 returned error can't find the container with id 5c60ae1f31fdf9cd2bba0d63e331065961091cdcb5a0088b56f661fa48141ca1
Jul 20 19:46:28.643482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:28.643451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/must-gather-hjpll" event={"ID":"57254a88-3219-4784-86fa-a42d134ae11c","Type":"ContainerStarted","Data":"5c60ae1f31fdf9cd2bba0d63e331065961091cdcb5a0088b56f661fa48141ca1"}
Jul 20 19:46:29.655079 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:29.655037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/must-gather-hjpll" event={"ID":"57254a88-3219-4784-86fa-a42d134ae11c","Type":"ContainerStarted","Data":"b9b8fb232c13afb5228dcf49508bc755423b01950e20181db772b0e97d435c01"}
Jul 20 19:46:29.655585 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:29.655098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/must-gather-hjpll" event={"ID":"57254a88-3219-4784-86fa-a42d134ae11c","Type":"ContainerStarted","Data":"633237fe995b3e986fb51f4edad21eea9cc082289d38d4cb72b8b593efc14b62"}
Jul 20 19:46:29.678358 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:29.678298    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxb5l/must-gather-hjpll" podStartSLOduration=1.840814404 podStartE2EDuration="2.678279605s" totalImagesPullingTime="837.465201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:46:29.676527922 +0000 UTC m=+2749.858051111" watchObservedRunningTime="2026-07-20 19:46:29.678279605 +0000 UTC m=+2749.859802794"
Jul 20 19:46:30.463927 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:30.463897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8t5rd_9d53abec-004c-4159-b75d-8186ce8fb603/global-pull-secret-syncer/0.log"
Jul 20 19:46:30.624029 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:30.623994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vtjzs_701ed924-7ad8-446c-9857-0e93c1e6d469/konnectivity-agent/0.log"
Jul 20 19:46:30.676146 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:30.676116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-117.ec2.internal_b0c8e33f498af61e3378f629da1c93b8/haproxy/0.log"
Jul 20 19:46:34.282570 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.282527    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/extract/0.log"
Jul 20 19:46:34.304653 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.304565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/util/0.log"
Jul 20 19:46:34.330586 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.330552    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wqrdg_51977de3-b7bf-45ca-b903-4f85b043ab2a/pull/0.log"
Jul 20 19:46:34.374512 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.374486    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/extract/0.log"
Jul 20 19:46:34.401768 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.401727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/util/0.log"
Jul 20 19:46:34.426056 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.425982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06wqqw_4ec20362-1878-43db-94af-840e01232139/pull/0.log"
Jul 20 19:46:34.468935 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.468889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/extract/0.log"
Jul 20 19:46:34.490112 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.490080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/util/0.log"
Jul 20 19:46:34.515881 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.515817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j6zwz_b4da8d96-a5bd-4f2c-915d-19fe388ec9ef/pull/0.log"
Jul 20 19:46:34.545416 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.545331    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/extract/0.log"
Jul 20 19:46:34.574360 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.574315    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/util/0.log"
Jul 20 19:46:34.622807 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:34.622747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rxqzg_059bfe64-334d-4250-9837-f3c32c3c8305/pull/0.log"
Jul 20 19:46:35.124001 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.123895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cdcb58dd6-4xxvd_e6d40cf6-849b-4f96-8915-42b4b6e14b53/authorino/0.log"
Jul 20 19:46:35.152151 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.152120    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mtvgj_35163c8d-52be-47ab-b29b-d697a487dae4/manager/0.log"
Jul 20 19:46:35.200344 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.199965    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-76zwb_458a99d6-2a51-49dd-b718-00379971e243/manager/0.log"
Jul 20 19:46:35.319404 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.319056    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ld6xl_3135ac5c-260e-484f-9a0a-c9f4a9288d32/registry-server/0.log"
Jul 20 19:46:35.536779 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.536512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xfk8h_632a2e01-3066-4a74-a826-f710b8a229ea/manager/0.log"
Jul 20 19:46:35.646401 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:35.646348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zdcr7_b7427d9a-543d-4b36-9f06-7c4a5c76585d/manager/0.log"
Jul 20 19:46:37.480236 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.480207    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2k78_5f13897e-0ed4-411b-885f-556c86cda224/node-exporter/0.log"
Jul 20 19:46:37.505449 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.505421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2k78_5f13897e-0ed4-411b-885f-556c86cda224/kube-rbac-proxy/0.log"
Jul 20 19:46:37.527880 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.527856    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2k78_5f13897e-0ed4-411b-885f-556c86cda224/init-textfile/0.log"
Jul 20 19:46:37.721857 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.721774    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wm7sv_5da54037-7824-4acd-8f1d-25e7f430e778/kube-rbac-proxy-main/0.log"
Jul 20 19:46:37.742374 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.742278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wm7sv_5da54037-7824-4acd-8f1d-25e7f430e778/kube-rbac-proxy-self/0.log"
Jul 20 19:46:37.765799 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:37.765747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wm7sv_5da54037-7824-4acd-8f1d-25e7f430e778/openshift-state-metrics/0.log"
Jul 20 19:46:38.024677 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:38.024631    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5vpfd_35a14c6d-3651-470e-acdd-fa77ac3533ca/prometheus-operator/0.log"
Jul 20 19:46:38.045054 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:38.044997    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5vpfd_35a14c6d-3651-470e-acdd-fa77ac3533ca/kube-rbac-proxy/0.log"
Jul 20 19:46:40.615393 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.615345    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"]
Jul 20 19:46:40.621512 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.621484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.627491 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.627424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"]
Jul 20 19:46:40.703170 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.703137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxk2w\" (UniqueName: \"kubernetes.io/projected/ed70fc57-4a86-48e0-b300-60121e360d96-kube-api-access-sxk2w\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.703388 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.703372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-lib-modules\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.703508 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.703498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-sys\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.703613 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.703604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-proc\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.703708 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.703698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-podres\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804372 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk2w\" (UniqueName: \"kubernetes.io/projected/ed70fc57-4a86-48e0-b300-60121e360d96-kube-api-access-sxk2w\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-lib-modules\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-sys\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-proc\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804557 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-podres\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804690    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-podres\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.804950 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.804916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-sys\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.805105 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.805031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-lib-modules\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.805228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.805094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed70fc57-4a86-48e0-b300-60121e360d96-proc\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.814003 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.813976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxk2w\" (UniqueName: \"kubernetes.io/projected/ed70fc57-4a86-48e0-b300-60121e360d96-kube-api-access-sxk2w\") pod \"perf-node-gather-daemonset-z5hdh\" (UID: \"ed70fc57-4a86-48e0-b300-60121e360d96\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:40.842352 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.842323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c677d4dfb-679bz_ebaf701c-3352-4324-839b-21ff12e4f167/console/0.log"
Jul 20 19:46:40.935481 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:40.935397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:41.104219 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:41.102860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"]
Jul 20 19:46:41.769279 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:41.769234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh" event={"ID":"ed70fc57-4a86-48e0-b300-60121e360d96","Type":"ContainerStarted","Data":"8715ff686b03ce27923b3b1d624db2402ee8c669645c58e24b0d1d2233365a57"}
Jul 20 19:46:41.769785 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:41.769309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh" event={"ID":"ed70fc57-4a86-48e0-b300-60121e360d96","Type":"ContainerStarted","Data":"8047da22e9670085d74ed954bcbfc5066c79ca11ee8f8b3ed53f321e7676de5f"}
Jul 20 19:46:41.770038 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:41.769995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:41.788577 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:41.788518    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh" podStartSLOduration=1.788501326 podStartE2EDuration="1.788501326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:46:41.787513811 +0000 UTC m=+2761.969037015" watchObservedRunningTime="2026-07-20 19:46:41.788501326 +0000 UTC m=+2761.970024517"
Jul 20 19:46:42.660713 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:42.660681    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vc88l_5556ad11-00a2-46db-8319-4b4a546eac0c/dns/0.log"
Jul 20 19:46:42.692991 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:42.692967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vc88l_5556ad11-00a2-46db-8319-4b4a546eac0c/kube-rbac-proxy/0.log"
Jul 20 19:46:42.747340 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:42.747313    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r92cd_ab6e36f0-2426-4402-bdb6-f0d09978aeda/dns-node-resolver/0.log"
Jul 20 19:46:43.364772 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:43.364729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wrwq_ed7c12d2-c7df-4da6-a842-a2b60e7cdd92/node-ca/0.log"
Jul 20 19:46:44.413102 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:44.413066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf445pz6_849fdb7c-4857-4e13-84ec-e76b7c7c2148/istio-proxy/0.log"
Jul 20 19:46:44.593188 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:44.593161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-zzv96_a6a779f7-0628-4107-9903-a2483691c07b/kube-auth-proxy/0.log"
Jul 20 19:46:44.625781 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:44.625734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/0.log"
Jul 20 19:46:44.658858 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:44.658825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/1.log"
Jul 20 19:46:44.691899 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:44.691815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8krcx_a9fcdd8b-0534-4f90-b984-959e267d2b06/payload-pre-processing/0.log"
Jul 20 19:46:45.455796 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:45.455749    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8dhrp_1a1e27eb-df84-4f49-ad7c-264867e7d0bb/serve-healthcheck-canary/0.log"
Jul 20 19:46:46.166869 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:46.166841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5rvt_887948ab-d6b3-44b5-b536-65060ab1ef14/kube-rbac-proxy/0.log"
Jul 20 19:46:46.193659 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:46.193629    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5rvt_887948ab-d6b3-44b5-b536-65060ab1ef14/exporter/0.log"
Jul 20 19:46:46.217433 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:46.217402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x5rvt_887948ab-d6b3-44b5-b536-65060ab1ef14/extractor/0.log"
Jul 20 19:46:48.361482 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.361452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v8flf_53bcd4b8-0749-40e1-9d0b-f9fb064da415/manager/0.log"
Jul 20 19:46:48.605810 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.605752    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5lrvq_d42812ee-7b77-49d5-a3d0-dfcdb41fe790/manager/0.log"
Jul 20 19:46:48.754305 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.754274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55476c59db-lw2dr_a990562a-c5b5-4469-89f6-e8085faf2ce7/manager/0.log"
Jul 20 19:46:48.774716 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.774688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-58p4w_cb5c8a6e-7ad9-4755-8797-d31de46d3e70/server/0.log"
Jul 20 19:46:48.794126 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.794100    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-z5hdh"
Jul 20 19:46:48.860506 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.860474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4p8rq_c08ef001-a82d-4282-8068-950cdd25c4d7/manager/0.log"
Jul 20 19:46:48.964100 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.964070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-d9nqq_dc53a6f7-92fd-47be-ae45-594e3c3b6a0b/manager/0.log"
Jul 20 19:46:48.983319 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:48.983291    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-d9nqq_dc53a6f7-92fd-47be-ae45-594e3c3b6a0b/copy-manifests/0.log"
Jul 20 19:46:50.336814 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.336787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gl8gz_9a112a68-b433-4a96-8c44-d5095bd177b7/openshift-lws-operator/0.log"
Jul 20 19:46:50.411147 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.411109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf445pz6_849fdb7c-4857-4e13-84ec-e76b7c7c2148/istio-proxy/0.log"
Jul 20 19:46:50.557318 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.557237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-zzv96_a6a779f7-0628-4107-9903-a2483691c07b/kube-auth-proxy/0.log"
Jul 20 19:46:50.583254 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.583179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/0.log"
Jul 20 19:46:50.617282 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.617178    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/1.log"
Jul 20 19:46:50.645142 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:50.645110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8krcx_a9fcdd8b-0534-4f90-b984-959e267d2b06/payload-pre-processing/0.log"
Jul 20 19:46:52.071163 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:52.071130    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf445pz6_849fdb7c-4857-4e13-84ec-e76b7c7c2148/istio-proxy/0.log"
Jul 20 19:46:52.221143 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:52.221061    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bb86f76-zzv96_a6a779f7-0628-4107-9903-a2483691c07b/kube-auth-proxy/0.log"
Jul 20 19:46:52.251228 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:52.251182    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/0.log"
Jul 20 19:46:52.277446 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:52.277416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hbn5j_5ceb4421-21dc-41c3-beb1-a52e8b6e57b7/istio-proxy/1.log"
Jul 20 19:46:52.304091 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:52.304059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8krcx_a9fcdd8b-0534-4f90-b984-959e267d2b06/payload-pre-processing/0.log"
Jul 20 19:46:55.432719 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:55.432686    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kf2t8_2cd67e06-346e-4658-b23c-9af2ccd3a4e9/migrator/0.log"
Jul 20 19:46:55.455312 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:55.455281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-kf2t8_2cd67e06-346e-4658-b23c-9af2ccd3a4e9/graceful-termination/0.log"
Jul 20 19:46:57.123279 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.123246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/kube-multus-additional-cni-plugins/0.log"
Jul 20 19:46:57.145394 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.145366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/egress-router-binary-copy/0.log"
Jul 20 19:46:57.166435 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.166408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/cni-plugins/0.log"
Jul 20 19:46:57.191749 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.191727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/bond-cni-plugin/0.log"
Jul 20 19:46:57.212821 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.212799    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/routeoverride-cni/0.log"
Jul 20 19:46:57.233093 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.233070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/whereabouts-cni-bincopy/0.log"
Jul 20 19:46:57.253668 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.253644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6v25_2271c277-e9bc-40a1-a143-dca573b3acfa/whereabouts-cni/0.log"
Jul 20 19:46:57.352729 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.352700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlw65_459e61c5-565c-49a4-8862-683c1116c1d4/kube-multus/0.log"
Jul 20 19:46:57.372679 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.372644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2mqms_2d98a244-009f-4dd6-be61-c588d549bbb7/network-metrics-daemon/0.log"
Jul 20 19:46:57.391119 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:57.391055    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2mqms_2d98a244-009f-4dd6-be61-c588d549bbb7/kube-rbac-proxy/0.log"
Jul 20 19:46:58.758540 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.758469    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-controller/0.log"
Jul 20 19:46:58.786569 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.786542    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/0.log"
Jul 20 19:46:58.786743 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.786581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/ovn-acl-logging/1.log"
Jul 20 19:46:58.807888 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.807864    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/kube-rbac-proxy-node/0.log"
Jul 20 19:46:58.834707 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.834678    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 19:46:58.859267 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.859246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/northd/0.log"
Jul 20 19:46:58.892417 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.892395    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/nbdb/0.log"
Jul 20 19:46:58.913560 ip-10-0-135-117 kubenswrapper[2563]: I0720 19:46:58.913535    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8mmzh_9dab84bb-c8b8-411d-ad50-98c9104ca8c8/sbdb/0.log"