Jul 19 14:11:06.561283 ip-10-0-141-191 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 19 14:11:06.561293 ip-10-0-141-191 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 19 14:11:06.561299 ip-10-0-141-191 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 19 14:11:06.561510 ip-10-0-141-191 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 19 14:11:16.210291 ip-10-0-141-191 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 19 14:11:16.210306 ip-10-0-141-191 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4d50c58aaf46460981912194db943971 --
Jul 19 14:12:46.589931 ip-10-0-141-191 systemd[1]: Starting Kubernetes Kubelet...
Jul 19 14:12:47.044728 ip-10-0-141-191 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:12:47.044728 ip-10-0-141-191 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 19 14:12:47.044728 ip-10-0-141-191 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:12:47.044728 ip-10-0-141-191 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 19 14:12:47.044728 ip-10-0-141-191 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:12:47.045717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.045629    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 19 14:12:47.052192 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052172    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.052192 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052189    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.052192 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052193    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.052192 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052197    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052200    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052204    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052207    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052210    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052212    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052215    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052218    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052220    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052223    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052225    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052228    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052230    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052233    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052235    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052257    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052260    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052263    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052266    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052269    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.052367 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052271    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052274    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052276    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052279    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052281    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052284    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052286    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052289    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052291    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052294    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052297    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052300    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052302    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052306    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052309    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052311    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052314    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052316    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052319    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.052848 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052322    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052324    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052327    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052329    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052332    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052334    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052337    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052339    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052342    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052345    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052347    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052350    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052352    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052355    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052357    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052360    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052362    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052365    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052368    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052371    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.053310 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052377    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052380    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052383    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052385    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052387    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052390    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052393    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052396    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052399    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052404    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052408    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052410    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052413    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052415    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052418    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052420    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052423    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052426    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052428    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052430    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.053808 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052433    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052436    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052439    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052441    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052444    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052447    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052449    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052452    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052455    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052459    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052462    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052465    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052468    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052471    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052474    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052478    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.052482    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053161    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053169    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.054336 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053173    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053176    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053179    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053182    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053184    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053187    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053190    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053194    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053196    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053199    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053202    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053205    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053207    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053210    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053212    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053216    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053218    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053221    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053223    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053226    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.054805 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053229    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053231    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053234    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053236    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053239    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053242    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053244    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053247    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053249    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053252    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053255    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053257    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053260    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053262    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053265    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053268    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053270    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053272    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053275    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053278    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.055307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053280    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053283    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053285    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053287    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053290    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053292    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053294    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053297    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053300    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053303    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053308    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053311    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053315    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053318    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053321    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053324    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053327    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053330    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053332    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053335    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.055781 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053338    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053342    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053345    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053348    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053351    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053354    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053357    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053360    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053362    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053365    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053367    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053370    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053372    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053375    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053377    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053380    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053382    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053385    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053387    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.056255 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053389    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053393    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053396    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053399    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053401    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053404    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053406    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053409    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053412    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053415    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053417    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053420    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053422    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053425    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053427    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053431    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053435    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053437    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053815    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.056711 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053822    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053825    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053828    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053831    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053833    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053836    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053839    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053841    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053844    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053846    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053849    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053852    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053854    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053856    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053859    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053862    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053885    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053888    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053892    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.057153 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053895    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053897    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053900    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053903    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053905    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053908    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053910    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053913    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053915    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053918    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053920    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053923    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053925    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053928    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053930    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053933    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053935    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053938    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053941    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053943    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.057615 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053945    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053948    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053950    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053953    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053955    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053957    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053960    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053962    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053965    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053969    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053972    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053974    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053977    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053979    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053982    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053985    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053988    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053990    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053992    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.058138 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053995    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.053997    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054000    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054002    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054005    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054007    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054009    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054012    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054015    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054017    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054020    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054022    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054025    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054027    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054030    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054032    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054035    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054037    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054050    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054054    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.058727 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054057    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054059    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054062    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054066    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054068    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054073    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054076    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054078    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054081    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054083    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054086    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054088    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054091    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054093    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054096    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054098    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054101    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054103    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054105    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054108    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.059211 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054177    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054183    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054189    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054193    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054197    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054200    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054204    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054208    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054211    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054214    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054217    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054220    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054223    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054226    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054231    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054234    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054237    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054240    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054244    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054247    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054250    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054253    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054257    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054260    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 19 14:12:47.059724 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054263    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054266    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054269    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054272    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054275    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054278    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054281    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054284    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054288    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054291    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054294    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054296    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054299    2582 flags.go:64] FLAG: --enable-server="true"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054302    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054307    2582 flags.go:64] FLAG: --event-burst="100"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054310    2582 flags.go:64] FLAG: --event-qps="50"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054313    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054316    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054318    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054322    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054325    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054328    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054332    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054335    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054338    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 19 14:12:47.060333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054341    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054345    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054350    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054353    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054356    2582 flags.go:64] FLAG: --feature-gates=""
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054360    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054362    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054365    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054368    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054371    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054374    2582 flags.go:64] FLAG: --help="false"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054377    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054380    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054383    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054386    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054389    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054393    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054396    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054399    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054401    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054404    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054407    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054410    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054413    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 19 14:12:47.060993 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054415    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054418    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054421    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054423    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054426    2582 flags.go:64] FLAG: --lock-file=""
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054432    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054435    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054437    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054443    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054446    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054450    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054453    2582 flags.go:64] FLAG: --logging-format="text"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054456    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054459    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054462    2582 flags.go:64] FLAG: --manifest-url=""
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054465    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054469    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054472    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054475    2582 flags.go:64] FLAG: --max-pods="110"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054478    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054481    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054484    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054487    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054490    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054493    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 19 14:12:47.061577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054496    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054506    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054509    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054511    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054514    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054517    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054522    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054525    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054528    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054531    2582 flags.go:64] FLAG: --port="10250"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054534    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054536    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-071006dcfe4ef0a5c"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054540    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054543    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054546    2582 flags.go:64] FLAG: --register-node="true"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054549    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054552    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054556    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054560    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054563    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054566    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054569    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054572    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054575    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054577    2582 flags.go:64] FLAG: --runonce="false"
Jul 19 14:12:47.062626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054580    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054583    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054586    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054588    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054592    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054595    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054597    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054600    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054603    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054606    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054609    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054612    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054615    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054618    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054621    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054626    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054629    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054631    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054635    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054639    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054642    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054645    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054647    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054650    2582 flags.go:64] FLAG: --v="2"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054654    2582 flags.go:64] FLAG: --version="false"
Jul 19 14:12:47.063704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054659    2582 flags.go:64] FLAG: --vmodule=""
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054676    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.054679    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054791    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054796    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054799    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054802    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054805    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054808    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054811    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054813    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054816    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054818    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054821    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054824    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054827    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054829    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054832    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054835    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054838    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.064758 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054840    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054843    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054846    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054848    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054851    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054853    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054858    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054861    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054864    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054867    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054869    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054872    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054876    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054879    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054882    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054886    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054889    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054892    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054894    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.065305 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054897    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054899    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054902    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054905    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054908    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054911    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054914    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054917    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054920    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054923    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054926    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054928    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054931    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054934    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054937    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054940    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054942    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054945    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054948    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054951    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.066170 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054954    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054956    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054959    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054961    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054964    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054968    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054970    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054973    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054976    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054979    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054981    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054984    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054986    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054989    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054991    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054994    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054997    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.054999    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055002    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055005    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.066960 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055008    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055010    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055013    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055015    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055018    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055020    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055023    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055025    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055028    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055030    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055033    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055035    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055037    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055040    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055042    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055045    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055047    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055051    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055054    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055056    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.067451 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055060    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055062    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.055065    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.055812    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.063309    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.063328    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.063353    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.063362    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063445    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063453    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063459    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063464    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063469    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063473    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063478    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.068077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063483    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063488    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063492    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063496    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063500    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063505    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063509    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063513    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063517    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063522    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063526    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063530    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063534    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063538    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063542    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063547    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063551    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063556    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063560    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063564    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.068477 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063568    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063572    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063577    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063582    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063586    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063590    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063594    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063598    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063603    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063609    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063614    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063619    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063623    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063627    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063633    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063639    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063643    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063648    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.068997 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063653    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063657    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063662    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063683    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063688    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063691    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063696    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063700    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063703    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063707    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063712    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063715    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063720    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063724    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063728    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063732    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063737    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063741    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063746    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063750    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.069487 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063754    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063758    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063764    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063770    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063774    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063779    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063783    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063787    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063791    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063795    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063800    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063804    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063808    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063812    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063816    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063821    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063824    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063828    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063833    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063837    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.070055 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063842    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063846    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063851    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063855    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063859    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063863    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063869    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063873    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063878    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063882    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063886    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063890    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063895    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.063899    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.063907    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:12:47.070596 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064076    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064083    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064088    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064092    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064097    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064101    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064106    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064111    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064117    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064123    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064128    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064133    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064137    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064142    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064146    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064150    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064154    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064158    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064163    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:12:47.070986 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064167    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064171    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064175    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064179    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064185    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064189    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064193    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064197    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064202    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064206    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064210    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064214    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064218    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064222    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064227    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064231    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064235    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064239    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064244    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064248    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:12:47.071480 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064252    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064256    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064260    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064264    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064268    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064272    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064276    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064280    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064284    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064288    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064292    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064298    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064304    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064308    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064314    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064318    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064323    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064328    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064332    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:12:47.071992 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064337    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064341    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064345    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064350    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064354    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064359    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064363    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064367    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064371    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064375    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064379    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064383    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064387    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064391    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064395    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064400    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064404    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064410    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064415    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064420    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:12:47.072465 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064424    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064428    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064433    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064437    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064441    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064445    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064449    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064453    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064457    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064461    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064465    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064470    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064475    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064479    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064483    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064487    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064490    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064494    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064499    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064503    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:12:47.073278 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:47.064507    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.064515    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.064659    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.067605    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.069310    2582 server.go:1019] "Starting client certificate rotation"
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.069407    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.069443    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:12:47.074462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.073077    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:12:47.079237 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.079213    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:12:47.091457 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.091440    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 19 14:12:47.094896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.094802    2582 log.go:25] "Validated CRI v1 image API"
Jul 19 14:12:47.096263 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.096248    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 19 14:12:47.099621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.099605    2582 fs.go:135] Filesystem UUIDs: map[40aa56bd-e679-43b9-a188-1143b0c02220:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad3b48e0-cde7-4abf-9a42-1a1b3bcfc019:/dev/nvme0n1p3]
Jul 19 14:12:47.099690 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.099621    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 19 14:12:47.102697 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.102678    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:12:47.105089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.104982    2582 manager.go:216] Machine: {Timestamp:2026-07-19 14:12:47.103586622 +0000 UTC m=+0.387245058 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3169644 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24085b6b4f9ac1935de08563efecb1 SystemUUID:ec24085b-6b4f-9ac1-935d-e08563efecb1 BootID:4d50c58a-af46-4609-8191-2194db943971 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:0c:55:cb:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:0c:55:cb:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:dc:56:1b:c0:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 19 14:12:47.105089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.105089    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 19 14:12:47.105192 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.105165    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 19 14:12:47.108589 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.108566    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 19 14:12:47.108732 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.108592    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 19 14:12:47.109451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.109441    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 19 14:12:47.109484 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.109453    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 19 14:12:47.109484 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.109460    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:12:47.110287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.110277    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:12:47.112054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.112046    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 19 14:12:47.116491 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116479    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:12:47.116621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116612    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 19 14:12:47.116680 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116654    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 19 14:12:47.116680 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116676    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 19 14:12:47.116731 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116690    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 19 14:12:47.116731 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116698    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 19 14:12:47.116731 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.116706    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 19 14:12:47.117036 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.117026    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:12:47.117076 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.117043    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:12:47.119327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.119312    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 19 14:12:47.121757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.121745    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 19 14:12:47.121810 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.121775    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 19 14:12:47.123363 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123337    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 19 14:12:47.123438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123371    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 19 14:12:47.123438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123385    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 19 14:12:47.123438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123397    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 19 14:12:47.123438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123416    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 19 14:12:47.123438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123429    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123446    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123459    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123474    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123487    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123502    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 19 14:12:47.123649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.123514    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 19 14:12:47.124413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.124401    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 19 14:12:47.124413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.124412    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 19 14:12:47.127528 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.127516    2582 server.go:1268] "Started kubelet"
Jul 19 14:12:47.127650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.127609    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 19 14:12:47.127718 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.127651    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 19 14:12:47.127773 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.127720    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 19 14:12:47.132043 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.132015    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 19 14:12:47.132270 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.132248    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 19 14:12:47.132359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.132346    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 19 14:12:47.132407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.132355    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 19 14:12:47.132606 ip-10-0-141-191 systemd[1]: Started Kubernetes Kubelet.
Jul 19 14:12:47.137192 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.137165    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 19 14:12:47.137562 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.137539    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 19 14:12:47.140258 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.139221    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-191.ec2.internal.18c3b65828d85738  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-191.ec2.internal,UID:ip-10-0-141-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-191.ec2.internal,},FirstTimestamp:2026-07-19 14:12:47.127492408 +0000 UTC m=+0.411150844,LastTimestamp:2026-07-19 14:12:47.127492408 +0000 UTC m=+0.411150844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-191.ec2.internal,}"
Jul 19 14:12:47.142784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.142769    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 19 14:12:47.142784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.142776    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 19 14:12:47.142904 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.142855    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.143522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143492    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 19 14:12:47.143522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143495    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 19 14:12:47.143637 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143535    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 19 14:12:47.143637 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143631    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 19 14:12:47.143741 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143642    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 19 14:12:47.143794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143787    2582 factory.go:55] Registering systemd factory
Jul 19 14:12:47.143838 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143800    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 19 14:12:47.144008 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.143983    2582 factory.go:153] Registering CRI-O factory
Jul 19 14:12:47.144059 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.144011    2582 factory.go:223] Registration of the crio container factory successfully
Jul 19 14:12:47.144108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.144064    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 19 14:12:47.144108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.144084    2582 factory.go:103] Registering Raw factory
Jul 19 14:12:47.144108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.144095    2582 manager.go:1196] Started watching for new ooms in manager
Jul 19 14:12:47.144568 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.144553    2582 manager.go:349] Starting recovery of all containers
Jul 19 14:12:47.145449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.145238    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjxzl"
Jul 19 14:12:47.146805 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.146775    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 19 14:12:47.146903 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.146877    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 19 14:12:47.152601 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.152578    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rjxzl"
Jul 19 14:12:47.157693 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.157678    2582 manager.go:354] Recovery completed
Jul 19 14:12:47.162459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.162444    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.164778 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.164762    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.164844 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.164788    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.164844 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.164798    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.165378 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.165366    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 19 14:12:47.165378 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.165377    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.165478 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.165397    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 19 14:12:47.165478 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.165413    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.166630    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.166658    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.166691    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.167225    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-191.ec2.internal.18c3b6582b113fa6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-191.ec2.internal,UID:ip-10-0-141-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-191.ec2.internal,},FirstTimestamp:2026-07-19 14:12:47.164776358 +0000 UTC m=+0.448434795,LastTimestamp:2026-07-19 14:12:47.164776358 +0000 UTC m=+0.448434795,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-191.ec2.internal,}"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.167827    2582 policy_none.go:49] "None policy: Start"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.167846    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 19 14:12:47.168145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.167862    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 19 14:12:47.169940 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.169927    2582 policy_none.go:47] "Start"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209315    2582 manager.go:337] "Starting Device Plugin manager"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.209343    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209355    2582 server.go:87] "Starting device plugin registration server"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209554    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209565    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209729    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209875    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.209887    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.210246    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 19 14:12:47.221585 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.210283    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.239598 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.239570    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 19 14:12:47.240686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.240656    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 19 14:12:47.240765 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.240702    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 19 14:12:47.240765 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.240719    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 19 14:12:47.240765 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.240746    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 19 14:12:47.242921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.242898    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:12:47.310158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.310096    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.310949 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.310930    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.311046 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.310961    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.311046 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.310972    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.311046 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.310993    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.323626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.323603    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.323626 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.323624    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-191.ec2.internal\": node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.340996 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.340975    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"]
Jul 19 14:12:47.341066 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.341029    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.342260 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.342246    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.342324 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.342274    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.342324 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.342287    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.344570 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.344558    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.344680 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.344656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.344722 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.344698    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.345229 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345214    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.345229 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345220    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.345333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345233    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.345333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345243    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.345333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345243    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.345333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.345312    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.346269 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.346254    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.347978 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.347963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.348053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.347987    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:12:47.348596 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.348575    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:12:47.348596 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.348599    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:12:47.348716 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.348609    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:12:47.370263 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.370246    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-191.ec2.internal\" not found" node="ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.374539 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.374526    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-191.ec2.internal\" not found" node="ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.444576 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.444559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.444662 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.444582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.446697 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.446683    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.545036 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.545010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.545091 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.545040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.545091 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.545058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cdb2a6ab87f995db98b4a51f49f0932c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-191.ec2.internal\" (UID: \"cdb2a6ab87f995db98b4a51f49f0932c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.545189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.545111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.545189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.545169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa07008dfd480ba3787de76673d7b880-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal\" (UID: \"fa07008dfd480ba3787de76673d7b880\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.547121 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.547109    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.645779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.645732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cdb2a6ab87f995db98b4a51f49f0932c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-191.ec2.internal\" (UID: \"cdb2a6ab87f995db98b4a51f49f0932c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.645779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.645773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cdb2a6ab87f995db98b4a51f49f0932c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-191.ec2.internal\" (UID: \"cdb2a6ab87f995db98b4a51f49f0932c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.647855 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.647842    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.673020 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.672997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.676929 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:47.676914    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:47.748766 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.748604    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.849091 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.849056    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:47.949241 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:47.949193    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:48.049959 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:48.049932    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:48.068027 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.068004    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 19 14:12:48.068176 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.068159    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 19 14:12:48.150328 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:48.150307    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:48.159084 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.159051    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-18 14:07:47 +0000 UTC" deadline="2027-12-20 22:00:52.06640726 +0000 UTC"
Jul 19 14:12:48.159084 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.159079    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12463h48m3.907331989s"
Jul 19 14:12:48.251103 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:48.251051    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:48.281943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.281926    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:12:48.351699 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:48.351665    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-191.ec2.internal\" not found"
Jul 19 14:12:48.354601 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.354584    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:12:48.403431 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.403406    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:12:48.443356 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.443338    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:48.456028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.456013    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:12:48.457081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.457053    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"
Jul 19 14:12:48.465180 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.465162    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:12:48.555878 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:48.555853    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb2a6ab87f995db98b4a51f49f0932c.slice/crio-79426ecb4570137942a1ab2551525305693b8cc171443cebecc234b9f532b49c WatchSource:0}: Error finding container 79426ecb4570137942a1ab2551525305693b8cc171443cebecc234b9f532b49c: Status 404 returned error can't find the container with id 79426ecb4570137942a1ab2551525305693b8cc171443cebecc234b9f532b49c
Jul 19 14:12:48.556339 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:48.556317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa07008dfd480ba3787de76673d7b880.slice/crio-6e85688a09b8f49b57cb90a00b27b44bd8ff04ed4d51415f1b229bfef6e6ac74 WatchSource:0}: Error finding container 6e85688a09b8f49b57cb90a00b27b44bd8ff04ed4d51415f1b229bfef6e6ac74: Status 404 returned error can't find the container with id 6e85688a09b8f49b57cb90a00b27b44bd8ff04ed4d51415f1b229bfef6e6ac74
Jul 19 14:12:48.561510 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:48.561483    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:12:49.120533 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.120513    2582 apiserver.go:52] "Watching apiserver"
Jul 19 14:12:49.129604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.129575    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 19 14:12:49.130885 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.130860    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nj6tn","openshift-multus/multus-additional-cni-plugins-2mpsx","openshift-multus/network-metrics-daemon-8pdkq","openshift-network-operator/iptables-alerter-7bpzm","openshift-ovn-kubernetes/ovnkube-node-nxvzm","kube-system/global-pull-secret-syncer-c7l6c","kube-system/konnectivity-agent-4mrfd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c","openshift-cluster-node-tuning-operator/tuned-z8tcz","openshift-dns/node-resolver-frw6w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal","openshift-multus/multus-v8q58","openshift-network-diagnostics/network-check-target-69fkk","kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal"]
Jul 19 14:12:49.134733 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.134712    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.136998 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.136977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 19 14:12:49.137087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.137029    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 19 14:12:49.137087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.137056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jbb7g\""
Jul 19 14:12:49.137702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.137667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:49.137788 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.137763    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:49.139969 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.139953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.140027 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.140010    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:49.142242 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.142223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.143501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.143482    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 19 14:12:49.144469 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.144452    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 19 14:12:49.144573 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.144499    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sj7q7\""
Jul 19 14:12:49.144573 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.144566    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.144721 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.144594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.144813 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.144790    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.146925 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.146907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.147022 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.146965    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:12:49.147682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.147664    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 19 14:12:49.147812 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.147799    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.147896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.147881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 19 14:12:49.148015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.147937    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 19 14:12:49.148081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.148012    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tbpjs\""
Jul 19 14:12:49.148081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.148020    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.148081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.148050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 19 14:12:49.149343 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.149323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.151383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.151364    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.151474 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.151364    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sv2x4\""
Jul 19 14:12:49.151474 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.151449    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.151763 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.151747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.153497 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.153480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 19 14:12:49.153738 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.153722    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.153819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.153808    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cgnh6\""
Jul 19 14:12:49.154109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.154093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.154109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.154094    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:12:49.154816 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.154746    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.155187 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-kubelet\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-systemd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-bin\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-config\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-script-lib\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d214e9bb-e32b-4878-972b-7906c247e374-konnectivity-ca\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-279rw\" (UniqueName: \"kubernetes.io/projected/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-kube-api-access-279rw\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-ovn\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-netd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d610a14-04aa-4738-a23c-4737e08c18f9-ovn-node-metrics-cert\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgwq\" (UniqueName: \"kubernetes.io/projected/5d610a14-04aa-4738-a23c-4737e08c18f9-kube-api-access-vvgwq\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d214e9bb-e32b-4878-972b-7906c247e374-agent-certs\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lbs\" (UniqueName: \"kubernetes.io/projected/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-kube-api-access-c4lbs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-netns\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-iptables-alerter-script\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-systemd-units\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-var-lib-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-env-overrides\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-host-slash\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.155867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-log-socket\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.156728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-slash\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.156728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-etc-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.156728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-node-log\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.156728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.155966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.157109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.157090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.158380 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.157442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.158380 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.158239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 19 14:12:49.158380 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.158368    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmqnx\""
Jul 19 14:12:49.158795 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.158462    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.158795 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.158244    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 19 14:12:49.158795 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.158572    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 19 14:12:49.160215 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.160191    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.160378 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.160359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sd8wj\""
Jul 19 14:12:49.160836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.160816    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.161204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.161183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.164052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.164032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.164717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.164667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 19 14:12:49.164868 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.164851    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sjnp6\""
Jul 19 14:12:49.164958 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.164907    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 19 14:12:49.165048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.165030    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 19 14:12:49.165921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.165894    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp2lq\""
Jul 19 14:12:49.166093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.166072    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 19 14:12:49.180324 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.180303    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-snx2v"
Jul 19 14:12:49.188709 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.188689    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-snx2v"
Jul 19 14:12:49.244732 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.244708    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 19 14:12:49.248706 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.248646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal" event={"ID":"cdb2a6ab87f995db98b4a51f49f0932c","Type":"ContainerStarted","Data":"79426ecb4570137942a1ab2551525305693b8cc171443cebecc234b9f532b49c"}
Jul 19 14:12:49.250734 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.250697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal" event={"ID":"fa07008dfd480ba3787de76673d7b880","Type":"ContainerStarted","Data":"6e85688a09b8f49b57cb90a00b27b44bd8ff04ed4d51415f1b229bfef6e6ac74"}
Jul 19 14:12:49.256548 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-tmp\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.256660 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-socket-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.256660 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-multus-certs\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.256660 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-279rw\" (UniqueName: \"kubernetes.io/projected/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-kube-api-access-279rw\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.256660 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-ovn\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.256660 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-netd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d610a14-04aa-4738-a23c-4737e08c18f9-ovn-node-metrics-cert\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgwq\" (UniqueName: \"kubernetes.io/projected/5d610a14-04aa-4738-a23c-4737e08c18f9-kube-api-access-vvgwq\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d214e9bb-e32b-4878-972b-7906c247e374-agent-certs\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-lib-modules\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-host\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-dbus\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-kubernetes\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-var-lib-kubelet\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-hostroot\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.256933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-ovn\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-systemd-units\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257076    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-netd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.257168    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:49.257418 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.257236    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:12:49.75721641 +0000 UTC m=+3.040874854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.256985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-systemd-units\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-system-cni-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-env-overrides\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257592    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9555\" (UniqueName: \"kubernetes.io/projected/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-kube-api-access-b9555\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257626    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257641    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cnibin\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.257794 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-os-release\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cni-binary-copy\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-netns\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-host-slash\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-log-socket\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-host-slash\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.257975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c133b6d-e8fb-415c-b652-2f5c0105b298-hosts-file\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-log-socket\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-sys-fs\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-etc-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-os-release\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-env-overrides\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c133b6d-e8fb-415c-b652-2f5c0105b298-tmp-dir\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-etc-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-kubelet-config\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysconfig\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.258397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668vg\" (UniqueName: \"kubernetes.io/projected/0657a598-aa2a-4f47-8c83-1869f6d170ee-kube-api-access-668vg\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-socket-dir-parent\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-conf\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-systemd\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-registration-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-k8s-cni-cncf-io\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-etc-kubernetes\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9g8\" (UniqueName: \"kubernetes.io/projected/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-kube-api-access-5r9g8\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-config\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d214e9bb-e32b-4878-972b-7906c247e374-konnectivity-ca\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-tuned\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-kubelet\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lbs\" (UniqueName: \"kubernetes.io/projected/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-kube-api-access-c4lbs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.259284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-netns\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-iptables-alerter-script\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-sys\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cnibin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-daemon-config\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-var-lib-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wgq\" (UniqueName: \"kubernetes.io/projected/7c133b6d-e8fb-415c-b652-2f5c0105b298-kube-api-access-84wgq\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-modprobe-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-system-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-bin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-conf-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.258985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-host\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6mj\" (UniqueName: \"kubernetes.io/projected/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-kube-api-access-vc6mj\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-config\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-slash\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-slash\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260113 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-netns\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-node-log\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-device-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrskt\" (UniqueName: \"kubernetes.io/projected/d337a724-ec12-4249-a0a2-fc60b737509e-kube-api-access-nrskt\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-var-lib-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259424    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-node-log\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259460    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-kubelet\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-systemd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-bin\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d214e9bb-e32b-4878-972b-7906c247e374-konnectivity-ca\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-serviceca\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-run\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-multus\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.260913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-kubelet\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-systemd\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-script-lib\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-iptables-alerter-script\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-run-openvswitch\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.259812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d610a14-04aa-4738-a23c-4737e08c18f9-host-cni-bin\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.260306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d610a14-04aa-4738-a23c-4737e08c18f9-ovnkube-script-lib\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.261896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.261815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d610a14-04aa-4738-a23c-4737e08c18f9-ovn-node-metrics-cert\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.262807 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.262786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d214e9bb-e32b-4878-972b-7906c247e374-agent-certs\") pod \"konnectivity-agent-4mrfd\" (UID: \"d214e9bb-e32b-4878-972b-7906c247e374\") " pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.266249 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.266229    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:12:49.266249 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.266256    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:12:49.266411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.266268    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:49.266411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.266330    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:49.766317811 +0000 UTC m=+3.049976236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:49.269839 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.269778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-279rw\" (UniqueName: \"kubernetes.io/projected/c1edddbf-f0ec-487f-a93b-d31c4ae7aa68-kube-api-access-279rw\") pod \"iptables-alerter-7bpzm\" (UID: \"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68\") " pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.270972 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.270929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lbs\" (UniqueName: \"kubernetes.io/projected/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-kube-api-access-c4lbs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.271062 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.270977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgwq\" (UniqueName: \"kubernetes.io/projected/5d610a14-04aa-4738-a23c-4737e08c18f9-kube-api-access-vvgwq\") pod \"ovnkube-node-nxvzm\" (UID: \"5d610a14-04aa-4738-a23c-4737e08c18f9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.360916 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.360883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-tuned\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.361052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.360926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-kubelet\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.360954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.361052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.360983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.361052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.361052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-sys\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cnibin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-daemon-config\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wgq\" (UniqueName: \"kubernetes.io/projected/7c133b6d-e8fb-415c-b652-2f5c0105b298-kube-api-access-84wgq\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-modprobe-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-system-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-bin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-conf-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-host\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6mj\" (UniqueName: \"kubernetes.io/projected/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-kube-api-access-vc6mj\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cnibin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.361407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-device-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrskt\" (UniqueName: \"kubernetes.io/projected/d337a724-ec12-4249-a0a2-fc60b737509e-kube-api-access-nrskt\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-serviceca\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-run\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-multus\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-tmp\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-socket-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-multus-certs\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-lib-modules\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-host\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-dbus\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-kubernetes\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-system-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-var-lib-kubelet\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-daemon-config\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361811    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-var-lib-kubelet\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.362024 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-hostroot\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-bin\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-hostroot\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-conf-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-system-cni-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-sys\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-system-cni-dir\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-kubelet\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9555\" (UniqueName: \"kubernetes.io/projected/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-kube-api-access-b9555\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-modprobe-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cnibin\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362087    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-kubernetes\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-cni-dir\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-os-release\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-socket-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.363015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-multus-certs\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-host\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cnibin\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-host\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-dbus\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.361387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-os-release\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-device-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cni-binary-copy\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-lib-modules\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-var-lib-cni-multus\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-netns\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-run\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c133b6d-e8fb-415c-b652-2f5c0105b298-hosts-file\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.364003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-sys-fs\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-os-release\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c133b6d-e8fb-415c-b652-2f5c0105b298-tmp-dir\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-kubelet-config\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysconfig\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-netns\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668vg\" (UniqueName: \"kubernetes.io/projected/0657a598-aa2a-4f47-8c83-1869f6d170ee-kube-api-access-668vg\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-socket-dir-parent\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-sys-fs\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7c133b6d-e8fb-415c-b652-2f5c0105b298-hosts-file\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-conf\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-d\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-systemd\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-cni-binary-copy\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-os-release\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-serviceca\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.364902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-registration-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.362623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysconfig\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363217    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-multus-socket-dir-parent\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.363257    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/235f95e3-d77f-46f7-a93f-47e3f0836278-kubelet-config\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d337a724-ec12-4249-a0a2-fc60b737509e-registration-dir\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.363306    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:49.863291881 +0000 UTC m=+3.146950308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-k8s-cni-cncf-io\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-systemd\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-sysctl-conf\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-etc-kubernetes\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9g8\" (UniqueName: \"kubernetes.io/projected/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-kube-api-access-5r9g8\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-host-run-k8s-cni-cncf-io\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c133b6d-e8fb-415c-b652-2f5c0105b298-tmp-dir\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.365818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.363438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-etc-kubernetes\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.366568 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.366015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-etc-tuned\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.368043 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.368018    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0657a598-aa2a-4f47-8c83-1869f6d170ee-tmp\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.371450 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.371375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6mj\" (UniqueName: \"kubernetes.io/projected/79cddbc8-dd39-4db8-a2fa-6336f41cf0a0-kube-api-access-vc6mj\") pod \"multus-additional-cni-plugins-2mpsx\" (UID: \"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0\") " pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.374544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.374487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9555\" (UniqueName: \"kubernetes.io/projected/7d3707c1-d4dc-4c14-8ba3-164704dbfc9e-kube-api-access-b9555\") pod \"node-ca-nj6tn\" (UID: \"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e\") " pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.375805 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.375772    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668vg\" (UniqueName: \"kubernetes.io/projected/0657a598-aa2a-4f47-8c83-1869f6d170ee-kube-api-access-668vg\") pod \"tuned-z8tcz\" (UID: \"0657a598-aa2a-4f47-8c83-1869f6d170ee\") " pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.376714 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.376689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrskt\" (UniqueName: \"kubernetes.io/projected/d337a724-ec12-4249-a0a2-fc60b737509e-kube-api-access-nrskt\") pod \"aws-ebs-csi-driver-node-g7v4c\" (UID: \"d337a724-ec12-4249-a0a2-fc60b737509e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.377145 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.377121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wgq\" (UniqueName: \"kubernetes.io/projected/7c133b6d-e8fb-415c-b652-2f5c0105b298-kube-api-access-84wgq\") pod \"node-resolver-frw6w\" (UID: \"7c133b6d-e8fb-415c-b652-2f5c0105b298\") " pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.377843 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.377545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9g8\" (UniqueName: \"kubernetes.io/projected/ef5fc17b-dabc-4f21-9229-dba7b6dd3604-kube-api-access-5r9g8\") pod \"multus-v8q58\" (UID: \"ef5fc17b-dabc-4f21-9229-dba7b6dd3604\") " pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.444562 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.444437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:12:49.453420 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.453399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bpzm"
Jul 19 14:12:49.464994 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.464975    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:12:49.471280 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.471255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z8tcz"
Jul 19 14:12:49.477956 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.477764    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nj6tn"
Jul 19 14:12:49.485116 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.485069    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0657a598_aa2a_4f47_8c83_1869f6d170ee.slice/crio-90b74f1539fb81f552023623f2f877e5029ff9b0364b7ed897a6ae928cf089ab WatchSource:0}: Error finding container 90b74f1539fb81f552023623f2f877e5029ff9b0364b7ed897a6ae928cf089ab: Status 404 returned error can't find the container with id 90b74f1539fb81f552023623f2f877e5029ff9b0364b7ed897a6ae928cf089ab
Jul 19 14:12:49.485244 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.485202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mpsx"
Jul 19 14:12:49.492472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.492452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frw6w"
Jul 19 14:12:49.492785 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.492730    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3707c1_d4dc_4c14_8ba3_164704dbfc9e.slice/crio-dda9c638057ed4ef4103af1072506209721f4faa4fd8778aaf3a85d6cb66c956 WatchSource:0}: Error finding container dda9c638057ed4ef4103af1072506209721f4faa4fd8778aaf3a85d6cb66c956: Status 404 returned error can't find the container with id dda9c638057ed4ef4103af1072506209721f4faa4fd8778aaf3a85d6cb66c956
Jul 19 14:12:49.501423 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.501401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c"
Jul 19 14:12:49.502077 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.502053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cddbc8_dd39_4db8_a2fa_6336f41cf0a0.slice/crio-b45a69d12aaae2fe052ec70d920b5bfbf9886ab22140466cf6c2ed367548a5b0 WatchSource:0}: Error finding container b45a69d12aaae2fe052ec70d920b5bfbf9886ab22140466cf6c2ed367548a5b0: Status 404 returned error can't find the container with id b45a69d12aaae2fe052ec70d920b5bfbf9886ab22140466cf6c2ed367548a5b0
Jul 19 14:12:49.505981 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.505595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v8q58"
Jul 19 14:12:49.517011 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.516968    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c133b6d_e8fb_415c_b652_2f5c0105b298.slice/crio-9600f72cb53b0619e7bfb0050c2f8167c486fe3445976afadeea4139ce94ea5f WatchSource:0}: Error finding container 9600f72cb53b0619e7bfb0050c2f8167c486fe3445976afadeea4139ce94ea5f: Status 404 returned error can't find the container with id 9600f72cb53b0619e7bfb0050c2f8167c486fe3445976afadeea4139ce94ea5f
Jul 19 14:12:49.518802 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.518778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd337a724_ec12_4249_a0a2_fc60b737509e.slice/crio-f82d8a4898cb0702ecd12057632af5b1b9144a055cf39d4a3fa15e484f62580f WatchSource:0}: Error finding container f82d8a4898cb0702ecd12057632af5b1b9144a055cf39d4a3fa15e484f62580f: Status 404 returned error can't find the container with id f82d8a4898cb0702ecd12057632af5b1b9144a055cf39d4a3fa15e484f62580f
Jul 19 14:12:49.525499 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:12:49.525473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5fc17b_dabc_4f21_9229_dba7b6dd3604.slice/crio-3de13073fc47de5ac3b7fd8f82178314defb6dd20195bc67404296646256c5b2 WatchSource:0}: Error finding container 3de13073fc47de5ac3b7fd8f82178314defb6dd20195bc67404296646256c5b2: Status 404 returned error can't find the container with id 3de13073fc47de5ac3b7fd8f82178314defb6dd20195bc67404296646256c5b2
Jul 19 14:12:49.526978 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.526958    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:12:49.766490 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.766396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:49.766490 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.766443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766568    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766575    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766600    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766610    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766630    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:12:50.766614132 +0000 UTC m=+4.050272559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:49.766737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.766659    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:50.766645419 +0000 UTC m=+4.050303861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:49.867636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:49.867596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:49.867818 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.867745    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:49.867818 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:49.867803    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:50.867784581 +0000 UTC m=+4.151443007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:50.192942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.192865    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:07:49 +0000 UTC" deadline="2028-03-19 02:43:04.380394855 +0000 UTC"
Jul 19 14:12:50.192942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.192894    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14604h30m14.187504168s"
Jul 19 14:12:50.254030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.254000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nj6tn" event={"ID":"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e","Type":"ContainerStarted","Data":"dda9c638057ed4ef4103af1072506209721f4faa4fd8778aaf3a85d6cb66c956"}
Jul 19 14:12:50.255376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.255347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z8tcz" event={"ID":"0657a598-aa2a-4f47-8c83-1869f6d170ee","Type":"ContainerStarted","Data":"90b74f1539fb81f552023623f2f877e5029ff9b0364b7ed897a6ae928cf089ab"}
Jul 19 14:12:50.256637 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.256600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8q58" event={"ID":"ef5fc17b-dabc-4f21-9229-dba7b6dd3604","Type":"ContainerStarted","Data":"3de13073fc47de5ac3b7fd8f82178314defb6dd20195bc67404296646256c5b2"}
Jul 19 14:12:50.257867 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.257842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c" event={"ID":"d337a724-ec12-4249-a0a2-fc60b737509e","Type":"ContainerStarted","Data":"f82d8a4898cb0702ecd12057632af5b1b9144a055cf39d4a3fa15e484f62580f"}
Jul 19 14:12:50.259185 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.259144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"2a947775094a0c71e562600ff551eacfc9643bd5f1bc1413d62b871cdeb91aeb"}
Jul 19 14:12:50.260458 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.260433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bpzm" event={"ID":"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68","Type":"ContainerStarted","Data":"162e7df55e7b621330631ce21a5df2e63e83d94c99bc297d4c613535bacae66f"}
Jul 19 14:12:50.261583 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.261559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mrfd" event={"ID":"d214e9bb-e32b-4878-972b-7906c247e374","Type":"ContainerStarted","Data":"6587ad27b54db982d98ec762910c4a2c48fdd95a4dac46b421214052dc5a2876"}
Jul 19 14:12:50.263048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.263020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frw6w" event={"ID":"7c133b6d-e8fb-415c-b652-2f5c0105b298","Type":"ContainerStarted","Data":"9600f72cb53b0619e7bfb0050c2f8167c486fe3445976afadeea4139ce94ea5f"}
Jul 19 14:12:50.264181 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.264161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerStarted","Data":"b45a69d12aaae2fe052ec70d920b5bfbf9886ab22140466cf6c2ed367548a5b0"}
Jul 19 14:12:50.776303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.776262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:50.776497 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.776315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:50.776582 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776508    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:12:50.776582 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776542    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:12:50.776582 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776561    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:50.776737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776511    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:50.776737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776622    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:52.776601835 +0000 UTC m=+6.060260265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:50.776737 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.776739    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:12:52.776720319 +0000 UTC m=+6.060378751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:50.877116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:50.877064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:50.877306 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.877241    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:50.877371 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:50.877326    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:52.877306072 +0000 UTC m=+6.160964502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:51.193446 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:51.193321    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:07:49 +0000 UTC" deadline="2028-02-04 09:21:52.379865442 +0000 UTC"
Jul 19 14:12:51.193446 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:51.193394    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13555h9m1.186475486s"
Jul 19 14:12:51.243603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:51.242861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:51.243603 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:51.243004    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:12:51.243603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:51.243464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:51.243603 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:51.243554    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:51.244225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:51.244077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:51.244225 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:51.244187    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:52.794405 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:52.794367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:52.795128 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:52.794500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:52.795128 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.794647    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:12:52.795128 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.794673    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:12:52.795128 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.794688    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:52.795128 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.794761    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:56.794740857 +0000 UTC m=+10.078399288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:52.795425 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.795201    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:52.795425 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.795255    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:12:56.795239043 +0000 UTC m=+10.078897499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:52.895928 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:52.895367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:52.895928 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.895509    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:52.895928 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:52.895581    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:12:56.895560611 +0000 UTC m=+10.179219038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:53.243566 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:53.242831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:53.243566 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:53.242961    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:53.243566 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:53.243352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:53.243566 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:53.243457    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:53.244134 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:53.243973    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:53.244134 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:53.244081    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:12:55.242287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:55.241793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:55.242287 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:55.241918    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:55.242287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:55.242034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:55.242287 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:55.242145    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:12:55.242287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:55.242226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:55.243008 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:55.242729    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:56.827264 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:56.827220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:56.827757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:56.827272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:56.827757 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827416    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:12:56.827757 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827444    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:12:56.827757 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827459    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:56.827757 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827540    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.827500987 +0000 UTC m=+18.111159418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:12:56.828039 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827420    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:56.828039 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.827934    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.827916949 +0000 UTC m=+18.111575378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:12:56.928078 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:56.928041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:56.928250 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.928173    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:56.928250 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:56.928234    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.928217293 +0000 UTC m=+18.211875743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:57.242470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:57.242603    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:57.242683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:57.242763    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:57.243103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:57.243272 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:57.243188    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:12:59.244072 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:59.242544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:12:59.250119 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:59.245207    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:12:59.250119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:59.245811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:12:59.250119 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:59.245962    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:12:59.250119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:12:59.246036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:12:59.250119 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:12:59.246152    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:01.241296 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:01.241212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:01.241769 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:01.241222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:01.241769 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:01.241334    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:01.241769 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:01.241222    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:01.241769 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:01.241471    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:01.241769 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:01.241580    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:03.240998 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:03.240962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:03.241430 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:03.240968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:03.241430 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:03.241091    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:03.241430 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:03.241139    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:03.241430 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:03.241175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:03.241430 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:03.241245    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:04.889639 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:04.889609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:04.889649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889786    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889810    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889834    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889838    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:13:20.889823114 +0000 UTC m=+34.173481539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889848    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.890118 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.889897    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:20.889879486 +0000 UTC m=+34.173537913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.990808 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:04.990770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:04.990973 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.990900    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:04.991045 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:04.990983    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:20.990968361 +0000 UTC m=+34.274626788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:05.241341 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:05.241246    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:05.241509 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:05.241382    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:05.241509 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:05.241246    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:05.241509 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:05.241406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:05.241509 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:05.241479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:05.241728 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:05.241600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:07.241808 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:07.241777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:07.242237 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:07.241866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:07.242237 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:07.241878    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:07.242237 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:07.241982    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:07.242237 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:07.242014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:07.242237 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:07.242083    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:09.241897 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.241588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:09.242328 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.241588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:09.242328 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.241762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:09.242328 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:09.242141    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:09.242328 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:09.242203    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:09.242328 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:09.242296    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:09.319055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.318608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal" event={"ID":"cdb2a6ab87f995db98b4a51f49f0932c","Type":"ContainerStarted","Data":"4f72f485ef775af9b4248c2f577150c16ed9980c8f54019c926c1c16f0f4d273"}
Jul 19 14:13:09.330771 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.330549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z8tcz" event={"ID":"0657a598-aa2a-4f47-8c83-1869f6d170ee","Type":"ContainerStarted","Data":"123f03ef699da3968dbdef0a9fb1134ca5ad69c3dd92e55667872aaade15bc4d"}
Jul 19 14:13:09.341769 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.341636    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v8q58" event={"ID":"ef5fc17b-dabc-4f21-9229-dba7b6dd3604","Type":"ContainerStarted","Data":"14a0d937a0fad1d0fb1b7169b9d3287a602455ed1abc210c7affdd509944763f"}
Jul 19 14:13:09.343986 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.343965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"64098bf90669cd3f5a5644cdebf5b530e9341ef91efb3fa2fdfbdd90d1e6bca5"}
Jul 19 14:13:09.344046 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.344031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"20f53a8281119a65dc3acd452a001593af56f2c124881b190da2736aaf20bc17"}
Jul 19 14:13:09.345715 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.345662    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-191.ec2.internal" podStartSLOduration=20.345649809 podStartE2EDuration="20.345649809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:09.345421517 +0000 UTC m=+22.629079965" watchObservedRunningTime="2026-07-19 14:13:09.345649809 +0000 UTC m=+22.629308255"
Jul 19 14:13:09.370388 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:09.370335    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z8tcz" podStartSLOduration=1.7849647069999999 podStartE2EDuration="21.370315264s" totalImagesPullingTime="19.585350557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:09.369817764 +0000 UTC m=+22.653476209" watchObservedRunningTime="2026-07-19 14:13:09.370315264 +0000 UTC m=+22.653973715"
Jul 19 14:13:10.348408 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.348322    2582 generic.go:356] "Generic (PLEG): container finished" podID="fa07008dfd480ba3787de76673d7b880" containerID="6b216188868a2d1fc83651b3854a5857fc8b69be66bb38e7a94c7f9544f335df" exitCode=0
Jul 19 14:13:10.349269 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.348408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal" event={"ID":"fa07008dfd480ba3787de76673d7b880","Type":"ContainerDied","Data":"6b216188868a2d1fc83651b3854a5857fc8b69be66bb38e7a94c7f9544f335df"}
Jul 19 14:13:10.350182 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.350157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frw6w" event={"ID":"7c133b6d-e8fb-415c-b652-2f5c0105b298","Type":"ContainerStarted","Data":"93d04998517d553d0e3a5ecf03743acf54a2b8dd4e34d359d177f025991345f4"}
Jul 19 14:13:10.351829 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.351805    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="2e7eb05b1f7c594e7cd19b5e1452dd50744d70518b4d6d996866524e9f5d86bb" exitCode=0
Jul 19 14:13:10.351921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.351891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"2e7eb05b1f7c594e7cd19b5e1452dd50744d70518b4d6d996866524e9f5d86bb"}
Jul 19 14:13:10.353493 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.353467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nj6tn" event={"ID":"7d3707c1-d4dc-4c14-8ba3-164704dbfc9e","Type":"ContainerStarted","Data":"d2cdfe798e62ee5969becaae5e54b78a00b3ea6ad5a348a6b3b6da7dff965088"}
Jul 19 14:13:10.355198 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.355178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c" event={"ID":"d337a724-ec12-4249-a0a2-fc60b737509e","Type":"ContainerStarted","Data":"6c6653bfa1d0d8896c4d0823ace1bb6bf880416adeea8bc64ff35f105abb504f"}
Jul 19 14:13:10.358560 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.358525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"0a35196cc86a7b017209162db45ced91e278fd94d607977462af43bc4d0bd301"}
Jul 19 14:13:10.358659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.358595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"303a189998a5e5ef10733d56e088d4843e925684e2e2c201d0104635407d477f"}
Jul 19 14:13:10.358659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.358631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"5a5955126051e0ac1ccd18007eb486a9ac4d3f3dced8e79e67532e658792aa7c"}
Jul 19 14:13:10.358659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.358659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"c83044454510e6dedf88d203577f04c72729dce3fb7f3716f1798772f8b6b3b9"}
Jul 19 14:13:10.362809 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.362780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mrfd" event={"ID":"d214e9bb-e32b-4878-972b-7906c247e374","Type":"ContainerStarted","Data":"758826b047d2598f6b79815a6e09a8238cf3173ab3f32546f1adc3d0c2a295e2"}
Jul 19 14:13:10.363170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.363109    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v8q58" podStartSLOduration=2.764460371 podStartE2EDuration="22.363094641s" totalImagesPullingTime="19.59863427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:09.387028822 +0000 UTC m=+22.670687270" watchObservedRunningTime="2026-07-19 14:13:10.363094641 +0000 UTC m=+23.646753089"
Jul 19 14:13:10.376911 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.376868    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4mrfd" podStartSLOduration=7.336962141 podStartE2EDuration="22.376854277s" totalImagesPullingTime="15.039892136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:10.376530041 +0000 UTC m=+23.660188492" watchObservedRunningTime="2026-07-19 14:13:10.376854277 +0000 UTC m=+23.660512723"
Jul 19 14:13:10.411291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.411232    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nj6tn" podStartSLOduration=2.847068289 podStartE2EDuration="22.411210031s" totalImagesPullingTime="19.564141742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:10.411080596 +0000 UTC m=+23.694739044" watchObservedRunningTime="2026-07-19 14:13:10.411210031 +0000 UTC m=+23.694868479"
Jul 19 14:13:10.946502 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:10.946341    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 19 14:13:11.221857 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.221662    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-19T14:13:10.94649701Z","UUID":"15c0a8b8-e461-4bf8-9f5e-5a160bbd3eec","Handler":null,"Name":"","Endpoint":""}
Jul 19 14:13:11.223211 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.223188    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 19 14:13:11.223319 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.223221    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 19 14:13:11.241060 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.241025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:11.241214 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:11.241138    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:11.241214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.241174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:11.241336 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.241182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:11.241336 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:11.241303    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:11.241433 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:11.241360    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:11.366850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.366815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c" event={"ID":"d337a724-ec12-4249-a0a2-fc60b737509e","Type":"ContainerStarted","Data":"4c1cd2f79873841a67bd4b4d17459be50be5fe45f1f79abba349384814beb08a"}
Jul 19 14:13:11.368578 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.368549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bpzm" event={"ID":"c1edddbf-f0ec-487f-a93b-d31c4ae7aa68","Type":"ContainerStarted","Data":"73636069d1c7f8e1f967bffd70d96ca8c9494e39eadee2e67ae874dee25fe7d5"}
Jul 19 14:13:11.370646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.370621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal" event={"ID":"fa07008dfd480ba3787de76673d7b880","Type":"ContainerStarted","Data":"ac133b27c317e791e74fad18fd804f42c6b9daec710889512a1c5c518e6eaedc"}
Jul 19 14:13:11.384836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.384779    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-frw6w" podStartSLOduration=3.841631132 podStartE2EDuration="23.384761129s" totalImagesPullingTime="19.543129997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:10.423365832 +0000 UTC m=+23.707024310" watchObservedRunningTime="2026-07-19 14:13:11.384761129 +0000 UTC m=+24.668419579"
Jul 19 14:13:11.385282 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.385248    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bpzm" podStartSLOduration=3.795331179 podStartE2EDuration="23.385239646s" totalImagesPullingTime="19.589908467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:11.38451275 +0000 UTC m=+24.668171210" watchObservedRunningTime="2026-07-19 14:13:11.385239646 +0000 UTC m=+24.668898092"
Jul 19 14:13:11.398911 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.398855    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-191.ec2.internal" podStartSLOduration=22.39883991 podStartE2EDuration="22.39883991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:11.398460013 +0000 UTC m=+24.682118457" watchObservedRunningTime="2026-07-19 14:13:11.39883991 +0000 UTC m=+24.682498355"
Jul 19 14:13:11.429626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.429596    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:13:11.430288 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:11.430273    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:13:12.378000 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:12.377955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"d198c550154c96901b9606fc3f6927c44a91c7940697db64571a4851909aa5bd"}
Jul 19 14:13:12.378544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:12.378066    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:13:12.378633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:12.378619    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4mrfd"
Jul 19 14:13:13.241808 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:13.241776    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:13.242019 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:13.241780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:13.242019 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:13.241913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:13.242019 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:13.241917    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:13.242019 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:13.242005    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:13.242179 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:13.242086    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:13.382944 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:13.382906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c" event={"ID":"d337a724-ec12-4249-a0a2-fc60b737509e","Type":"ContainerStarted","Data":"8c83a8abf1020a0ea4b5372a464fcb8b13dcff913181b6247f498781ae95828a"}
Jul 19 14:13:13.399742 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:13.399690    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7v4c" podStartSLOduration=2.98984105 podStartE2EDuration="25.399661974s" totalImagesPullingTime="22.409820924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:13.398968145 +0000 UTC m=+26.682626591" watchObservedRunningTime="2026-07-19 14:13:13.399661974 +0000 UTC m=+26.683320419"
Jul 19 14:13:15.241620 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.241487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:15.242033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.241496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:15.242033 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:15.241739    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:15.242033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.241524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:15.242033 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:15.241786    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:15.242033 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:15.241889    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:15.391941 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.391908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" event={"ID":"5d610a14-04aa-4738-a23c-4737e08c18f9","Type":"ContainerStarted","Data":"42d900c98850e29097caad2cd022a508d2d00b8e2d1fb7b289ff12a69cd9a802"}
Jul 19 14:13:15.392215 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.392188    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:15.392335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.392287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:15.414164 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.414137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:15.414268 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.414243    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:15.415031 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:15.414995    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm" podStartSLOduration=7.766653857 podStartE2EDuration="27.414982454s" totalImagesPullingTime="19.648328597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:15.413832211 +0000 UTC m=+28.697490662" watchObservedRunningTime="2026-07-19 14:13:15.414982454 +0000 UTC m=+28.698640906"
Jul 19 14:13:16.399319 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:16.397869    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="f5caae123cc915b334bebae46e00784697ec678d54926d7367b1c729215d21fd" exitCode=0
Jul 19 14:13:16.399319 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:16.398108    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 19 14:13:16.409679 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:16.404981    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"f5caae123cc915b334bebae46e00784697ec678d54926d7367b1c729215d21fd"}
Jul 19 14:13:16.782400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:16.782331    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:17.089533 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.089462    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pdkq"]
Jul 19 14:13:17.089689 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.089610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:17.089743 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:17.089725    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:17.092449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.092424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69fkk"]
Jul 19 14:13:17.092582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.092519    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:17.092702 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:17.092599    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:17.093079 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.093049    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7l6c"]
Jul 19 14:13:17.093184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:17.093138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:17.093233 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:17.093216    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:18.242014 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:18.241823    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:18.242392 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:18.241821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:18.242392 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:18.242106    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:18.242392 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:18.242153    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:18.242392 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:18.241821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:18.242392 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:18.242234    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:18.404760 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:18.404725    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="2370c1cb1ee75de8a0c5488ff253bc1ed6a173d92c7e455c43a535e792d14602" exitCode=0
Jul 19 14:13:18.404946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:18.404811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"2370c1cb1ee75de8a0c5488ff253bc1ed6a173d92c7e455c43a535e792d14602"}
Jul 19 14:13:20.241931 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.241899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:20.242304 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.241998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:20.242304 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.242021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:20.242304 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.242014    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:20.242304 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.242085    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:20.242304 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.242167    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:20.411793 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.411758    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="d1720ade9ff8e965633d755c4bd6be46897f7f339b8f6edf675a0a363703fd4f" exitCode=0
Jul 19 14:13:20.411971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.411807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"d1720ade9ff8e965633d755c4bd6be46897f7f339b8f6edf675a0a363703fd4f"}
Jul 19 14:13:20.902534 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.902497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:20.902747 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:20.902543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:20.902747 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902653    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:20.902747 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs podName:1d73e2c3-ebcf-4cd5-a26d-37224fb4880f nodeName:}" failed. No retries permitted until 2026-07-19 14:13:52.902717741 +0000 UTC m=+66.186376165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs") pod "network-metrics-daemon-8pdkq" (UID: "1d73e2c3-ebcf-4cd5-a26d-37224fb4880f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:20.902747 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902654    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:20.902927 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902768    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:20.902927 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902782    2582 projected.go:196] Error preparing data for projected volume kube-api-access-ctl7k for pod openshift-network-diagnostics/network-check-target-69fkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:20.902927 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:20.902822    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k podName:7d4219cc-0fc6-4f16-b73d-623acd6d6fa5 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:52.902810353 +0000 UTC m=+66.186468792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctl7k" (UniqueName: "kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k") pod "network-check-target-69fkk" (UID: "7d4219cc-0fc6-4f16-b73d-623acd6d6fa5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:21.002875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:21.002841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:21.003015 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:21.002940    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:21.003015 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:21.002989    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret podName:235f95e3-d77f-46f7-a93f-47e3f0836278 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:53.002976932 +0000 UTC m=+66.286635356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret") pod "global-pull-secret-syncer-c7l6c" (UID: "235f95e3-d77f-46f7-a93f-47e3f0836278") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:22.241077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.241038    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:22.241077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.241069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:22.241619 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.241080    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:22.241619 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:22.241176    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7l6c" podUID="235f95e3-d77f-46f7-a93f-47e3f0836278"
Jul 19 14:13:22.241619 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:22.241313    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69fkk" podUID="7d4219cc-0fc6-4f16-b73d-623acd6d6fa5"
Jul 19 14:13:22.241619 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:22.241407    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pdkq" podUID="1d73e2c3-ebcf-4cd5-a26d-37224fb4880f"
Jul 19 14:13:22.961284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.961255    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-191.ec2.internal" event="NodeReady"
Jul 19 14:13:22.961438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.961389    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 19 14:13:22.992899 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.992873    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"]
Jul 19 14:13:22.996530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.996449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"
Jul 19 14:13:22.998227 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.998207    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"]
Jul 19 14:13:22.999030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.998830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xjg9j\""
Jul 19 14:13:22.999030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.998831    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:22.999030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:22.998904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.001837 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.001820    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:13:23.001972 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.001955    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.004525 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.004144    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.004525 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.004226    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.004525 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.004289    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 19 14:13:23.004736 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.004714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wdxhg\""
Jul 19 14:13:23.005252 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.005232    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-t4k8d"]
Jul 19 14:13:23.005375 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.005352    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.008053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.007850    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 19 14:13:23.008214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.007907    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-knpqf\""
Jul 19 14:13:23.008406 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.007952    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 19 14:13:23.008520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.007965    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 19 14:13:23.009790 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.009195    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7944cdf68-hkq2v"]
Jul 19 14:13:23.009790 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.009328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.014705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.014683    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 19 14:13:23.015014 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.014996    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m7vbc\""
Jul 19 14:13:23.015341 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.015307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.016087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.016008    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-79qzm"]
Jul 19 14:13:23.016501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.016478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 19 14:13:23.026342 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.026316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"]
Jul 19 14:13:23.026557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.026539    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 19 14:13:23.027552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.027034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.027552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.027046    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.027552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.027209    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.029236 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.029215    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 19 14:13:23.029448 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.029427    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.029547 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.029432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-77n8w\""
Jul 19 14:13:23.029914 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.029656    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 19 14:13:23.029914 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.029761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030253    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030400    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030407    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030477    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"]
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030538    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"]
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.030631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.031445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.031045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2m9j9\""
Jul 19 14:13:23.034919 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.034000    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"]
Jul 19 14:13:23.034919 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.034541    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.037978 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.037475    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"]
Jul 19 14:13:23.038456 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.038437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 19 14:13:23.038639 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.038618    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wlpbj\""
Jul 19 14:13:23.038845 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.038815    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.039032 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039015    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.039142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.039201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.038497    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039220    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039115    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039294    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039133    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.039582 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.039454    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d56br\""
Jul 19 14:13:23.040925 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.040906    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"]
Jul 19 14:13:23.041037 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041024    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-t4k8d"]
Jul 19 14:13:23.041092 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041052    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"]
Jul 19 14:13:23.041092 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"
Jul 19 14:13:23.041092 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-79qzm"]
Jul 19 14:13:23.041092 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:13:23.041207 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041112    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2wlrr"]
Jul 19 14:13:23.041900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.041879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 19 14:13:23.042052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.042036    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.042178 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.042149    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.042245 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.042105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9r9lw\""
Jul 19 14:13:23.042245 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.042093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 19 14:13:23.043268 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.043248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.043642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.043504    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kkwpb\""
Jul 19 14:13:23.043642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.043618    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.045258 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.045241    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vlgrp"]
Jul 19 14:13:23.045366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.045351    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.047237 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.047218    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 19 14:13:23.047638 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.047623    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 19 14:13:23.047835 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.047625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 19 14:13:23.047903 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.047705    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dfvv\""
Jul 19 14:13:23.048686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048655    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"]
Jul 19 14:13:23.048779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048706    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"]
Jul 19 14:13:23.048779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048728    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7944cdf68-hkq2v"]
Jul 19 14:13:23.048779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.048928 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2wlrr"]
Jul 19 14:13:23.048928 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vlgrp"]
Jul 19 14:13:23.048928 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.048925    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"]
Jul 19 14:13:23.050466 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.050447    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n7vcv\""
Jul 19 14:13:23.050682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.050653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 19 14:13:23.050773 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.050732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 19 14:13:23.117153 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.117333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w7s4\" (UniqueName: \"kubernetes.io/projected/0bbc111b-df64-40ae-a9f4-e670d3a280e9-kube-api-access-5w7s4\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.117451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxhm\" (UniqueName: \"kubernetes.io/projected/206e76a1-cbcb-47f7-8260-bfd3ec2d3a31-kube-api-access-bgxhm\") pod \"volume-data-source-validator-78cf4c6f6-r4nqf\" (UID: \"206e76a1-cbcb-47f7-8260-bfd3ec2d3a31\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"
Jul 19 14:13:23.117451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lnv\" (UniqueName: \"kubernetes.io/projected/aedaacdf-446f-4dda-8e99-44027d5f8322-kube-api-access-r6lnv\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.117451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.117604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.117604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76530044-a09f-46e4-9872-c0ff1cd72546-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.117604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.117604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a7a8662-09de-4f65-80f7-f8cf29d56eab-serving-cert\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.117604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26409d1e-6375-465b-9c92-afad2a8cfef0-cert\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117602    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-stats-auth\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-snapshots\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.117847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aedaacdf-446f-4dda-8e99-44027d5f8322-config-volume\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7n4s\" (UniqueName: \"kubernetes.io/projected/4a7a8662-09de-4f65-80f7-f8cf29d56eab-kube-api-access-c7n4s\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-tmp\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.117953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcl56\" (UniqueName: \"kubernetes.io/projected/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-kube-api-access-fcl56\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-default-certificate\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.118121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-trusted-ca\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg6lv\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-config\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.118393 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aedaacdf-446f-4dda-8e99-44027d5f8322-tmp-dir\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhv7f\" (UniqueName: \"kubernetes.io/projected/26409d1e-6375-465b-9c92-afad2a8cfef0-kube-api-access-bhv7f\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqxs\" (UniqueName: \"kubernetes.io/projected/76530044-a09f-46e4-9872-c0ff1cd72546-kube-api-access-wpqxs\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8fb\" (UniqueName: \"kubernetes.io/projected/746525da-4951-4c57-9f42-3725407eeb15-kube-api-access-9j8fb\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-service-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.118691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6cd\" (UniqueName: \"kubernetes.io/projected/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-kube-api-access-5n6cd\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.119114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.119114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4zhq\" (UniqueName: \"kubernetes.io/projected/a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c-kube-api-access-m4zhq\") pod \"network-check-source-7bc5b6bf85-kwqzn\" (UID: \"a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"
Jul 19 14:13:23.119114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbc111b-df64-40ae-a9f4-e670d3a280e9-serving-cert\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.119114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-config\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.119114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.118831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngsb4\" (UniqueName: \"kubernetes.io/projected/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-kube-api-access-ngsb4\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.161402 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.161367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mrfd_d214e9bb-e32b-4878-972b-7906c247e374/konnectivity-agent/0.log" limit=1024
Jul 19 14:13:23.220094 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.219983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhv7f\" (UniqueName: \"kubernetes.io/projected/26409d1e-6375-465b-9c92-afad2a8cfef0-kube-api-access-bhv7f\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.220094 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqxs\" (UniqueName: \"kubernetes.io/projected/76530044-a09f-46e4-9872-c0ff1cd72546-kube-api-access-wpqxs\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8fb\" (UniqueName: \"kubernetes.io/projected/746525da-4951-4c57-9f42-3725407eeb15-kube-api-access-9j8fb\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-service-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.220327 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.220319    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6cd\" (UniqueName: \"kubernetes.io/projected/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-kube-api-access-5n6cd\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.220421    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.220425    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.720405236 +0000 UTC m=+37.004063661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4zhq\" (UniqueName: \"kubernetes.io/projected/a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c-kube-api-access-m4zhq\") pod \"network-check-source-7bc5b6bf85-kwqzn\" (UID: \"a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbc111b-df64-40ae-a9f4-e670d3a280e9-serving-cert\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-config\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngsb4\" (UniqueName: \"kubernetes.io/projected/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-kube-api-access-ngsb4\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.220707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w7s4\" (UniqueName: \"kubernetes.io/projected/0bbc111b-df64-40ae-a9f4-e670d3a280e9-kube-api-access-5w7s4\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.220725    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.720707349 +0000 UTC m=+37.004365787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxhm\" (UniqueName: \"kubernetes.io/projected/206e76a1-cbcb-47f7-8260-bfd3ec2d3a31-kube-api-access-bgxhm\") pod \"volume-data-source-validator-78cf4c6f6-r4nqf\" (UID: \"206e76a1-cbcb-47f7-8260-bfd3ec2d3a31\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lnv\" (UniqueName: \"kubernetes.io/projected/aedaacdf-446f-4dda-8e99-44027d5f8322-kube-api-access-r6lnv\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76530044-a09f-46e4-9872-c0ff1cd72546-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a7a8662-09de-4f65-80f7-f8cf29d56eab-serving-cert\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26409d1e-6375-465b-9c92-afad2a8cfef0-cert\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.220980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-stats-auth\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-snapshots\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-service-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.221184 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aedaacdf-446f-4dda-8e99-44027d5f8322-config-volume\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7n4s\" (UniqueName: \"kubernetes.io/projected/4a7a8662-09de-4f65-80f7-f8cf29d56eab-kube-api-access-c7n4s\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-tmp\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcl56\" (UniqueName: \"kubernetes.io/projected/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-kube-api-access-fcl56\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-default-certificate\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-trusted-ca\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg6lv\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-config\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-config\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aedaacdf-446f-4dda-8e99-44027d5f8322-tmp-dir\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7a8662-09de-4f65-80f7-f8cf29d56eab-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.221943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.221805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aedaacdf-446f-4dda-8e99-44027d5f8322-tmp-dir\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.221788    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.221833    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.221890    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.721874481 +0000 UTC m=+37.005532917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.221898    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.221947    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.721929403 +0000 UTC m=+37.005587835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.222045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.222696 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.222637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76530044-a09f-46e4-9872-c0ff1cd72546-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.223150 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.222928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.223150 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.222974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-snapshots\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.223150 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.223069    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.723054915 +0000 UTC m=+37.006713360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:23.223505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.223476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a7a8662-09de-4f65-80f7-f8cf29d56eab-tmp\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.223600 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.223504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-trusted-ca\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.223682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.223645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aedaacdf-446f-4dda-8e99-44027d5f8322-config-volume\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.224091 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.224073    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:23.224231 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.224189    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.224344 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.224236    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:23.724221768 +0000 UTC m=+37.007880197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:23.224344 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.224262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0bbc111b-df64-40ae-a9f4-e670d3a280e9-config\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.226198 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.226142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bbc111b-df64-40ae-a9f4-e670d3a280e9-serving-cert\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.226935 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.226765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.226935 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.226843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-default-certificate\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.227103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.227030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.227746 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.227723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.227838 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.227746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.227838 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.227818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a7a8662-09de-4f65-80f7-f8cf29d56eab-serving-cert\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.228507 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.228463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-stats-auth\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.228922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.228898    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26409d1e-6375-465b-9c92-afad2a8cfef0-cert\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.230021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.229997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqxs\" (UniqueName: \"kubernetes.io/projected/76530044-a09f-46e4-9872-c0ff1cd72546-kube-api-access-wpqxs\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.230382 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.230340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6cd\" (UniqueName: \"kubernetes.io/projected/1cbd0c5e-2265-46e9-813b-e80b66a84bf0-kube-api-access-5n6cd\") pod \"kube-storage-version-migrator-operator-7658d9b749-v6h5t\" (UID: \"1cbd0c5e-2265-46e9-813b-e80b66a84bf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.231560 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.231531    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w7s4\" (UniqueName: \"kubernetes.io/projected/0bbc111b-df64-40ae-a9f4-e670d3a280e9-kube-api-access-5w7s4\") pod \"console-operator-565b7b569d-t4k8d\" (UID: \"0bbc111b-df64-40ae-a9f4-e670d3a280e9\") " pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.233314 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.233271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8fb\" (UniqueName: \"kubernetes.io/projected/746525da-4951-4c57-9f42-3725407eeb15-kube-api-access-9j8fb\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.234443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.233842    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngsb4\" (UniqueName: \"kubernetes.io/projected/523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b-kube-api-access-ngsb4\") pod \"service-ca-operator-5bcbc94c78-58626\" (UID: \"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.234443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.234129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxhm\" (UniqueName: \"kubernetes.io/projected/206e76a1-cbcb-47f7-8260-bfd3ec2d3a31-kube-api-access-bgxhm\") pod \"volume-data-source-validator-78cf4c6f6-r4nqf\" (UID: \"206e76a1-cbcb-47f7-8260-bfd3ec2d3a31\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"
Jul 19 14:13:23.234443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.234180    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhv7f\" (UniqueName: \"kubernetes.io/projected/26409d1e-6375-465b-9c92-afad2a8cfef0-kube-api-access-bhv7f\") pod \"ingress-canary-2wlrr\" (UID: \"26409d1e-6375-465b-9c92-afad2a8cfef0\") " pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.234443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.234407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4zhq\" (UniqueName: \"kubernetes.io/projected/a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c-kube-api-access-m4zhq\") pod \"network-check-source-7bc5b6bf85-kwqzn\" (UID: \"a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"
Jul 19 14:13:23.234933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.234897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg6lv\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.234933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.234910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lnv\" (UniqueName: \"kubernetes.io/projected/aedaacdf-446f-4dda-8e99-44027d5f8322-kube-api-access-r6lnv\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.235806 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.235773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.235914 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.235840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7n4s\" (UniqueName: \"kubernetes.io/projected/4a7a8662-09de-4f65-80f7-f8cf29d56eab-kube-api-access-c7n4s\") pod \"insights-operator-555d9d7885-79qzm\" (UID: \"4a7a8662-09de-4f65-80f7-f8cf29d56eab\") " pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.236492 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.236472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcl56\" (UniqueName: \"kubernetes.io/projected/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-kube-api-access-fcl56\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.251095 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.251059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mrfd_d214e9bb-e32b-4878-972b-7906c247e374/konnectivity-agent/0.log" limit=1024
Jul 19 14:13:23.311532 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.311494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"
Jul 19 14:13:23.349183 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.349151    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:23.362796 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.362766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-79qzm"
Jul 19 14:13:23.376716 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.376498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"
Jul 19 14:13:23.383681 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.383646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"
Jul 19 14:13:23.391871 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.391683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"
Jul 19 14:13:23.397207 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.397184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2wlrr"
Jul 19 14:13:23.452473 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.452441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf"]
Jul 19 14:13:23.725465 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725610    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:23.725641 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725636    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.725682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725705    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725661496 +0000 UTC m=+38.009319939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725739    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725748    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725766    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725773    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725778    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725762553 +0000 UTC m=+38.009420982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725858    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725843438 +0000 UTC m=+38.009501866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725889    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725869742 +0000 UTC m=+38.009528174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725914    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725902987 +0000 UTC m=+38.009561416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:23.725968 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:23.725931    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:24.725922437 +0000 UTC m=+38.009580882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:23.846500 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.846456    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mrfd_d214e9bb-e32b-4878-972b-7906c247e374/konnectivity-agent/0.log" limit=1024
Jul 19 14:13:23.946894 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:23.946859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mrfd_d214e9bb-e32b-4878-972b-7906c247e374/konnectivity-agent/0.log" limit=1024
Jul 19 14:13:24.241210 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.241176    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:24.241399 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.241189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:24.241399 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.241320    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:24.243742 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.243724    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:13:24.244529 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.244508    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hzhh\""
Jul 19 14:13:24.244616 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.244509    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7cp9\""
Jul 19 14:13:24.244616 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.244550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:13:24.734866 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.734837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.734919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.734963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.734996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735047    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.735024675 +0000 UTC m=+40.018683100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735087    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735095    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735129    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.735117713 +0000 UTC m=+40.018776152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735090    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735152    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.735135483 +0000 UTC m=+40.018793909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.735100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735162    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735172    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.735163324 +0000 UTC m=+40.018821749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735176    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735209    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.73519842 +0000 UTC m=+40.018856846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:24.735246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:24.735750 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735359    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:24.736215 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:24.735412    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:26.735395872 +0000 UTC m=+40.019054309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:24.858261 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:24.858216    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206e76a1_cbcb_47f7_8260_bfd3ec2d3a31.slice/crio-917a6744652a31f058d3c7d7df7c720cd58b55ee5d5b91324e5d1b283e23e175 WatchSource:0}: Error finding container 917a6744652a31f058d3c7d7df7c720cd58b55ee5d5b91324e5d1b283e23e175: Status 404 returned error can't find the container with id 917a6744652a31f058d3c7d7df7c720cd58b55ee5d5b91324e5d1b283e23e175
Jul 19 14:13:25.093491 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.088565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-t4k8d"]
Jul 19 14:13:25.117621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.116933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-79qzm"]
Jul 19 14:13:25.119831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.119784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t"]
Jul 19 14:13:25.123394 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:25.123361    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7a8662_09de_4f65_80f7_f8cf29d56eab.slice/crio-fa3d97e35007947d6b39819426aca5f9c9a27ff3c4d80391d4a523a970a8d7ea WatchSource:0}: Error finding container fa3d97e35007947d6b39819426aca5f9c9a27ff3c4d80391d4a523a970a8d7ea: Status 404 returned error can't find the container with id fa3d97e35007947d6b39819426aca5f9c9a27ff3c4d80391d4a523a970a8d7ea
Jul 19 14:13:25.124521 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:25.124385    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbd0c5e_2265_46e9_813b_e80b66a84bf0.slice/crio-140964e5dde82cdd0657fe9bcec0dc0c6bea0ab8108fd1f00c376423e14f6f9a WatchSource:0}: Error finding container 140964e5dde82cdd0657fe9bcec0dc0c6bea0ab8108fd1f00c376423e14f6f9a: Status 404 returned error can't find the container with id 140964e5dde82cdd0657fe9bcec0dc0c6bea0ab8108fd1f00c376423e14f6f9a
Jul 19 14:13:25.134858 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.134839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn"]
Jul 19 14:13:25.137146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.137124    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626"]
Jul 19 14:13:25.138416 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:25.138392    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d1a251_809b_4f55_afbf_d2bbd6fd8a7c.slice/crio-105f49cd42e3fefc925701bd039ce10f4e70a15dcb0ad2b98398dd2ba9ad2e0b WatchSource:0}: Error finding container 105f49cd42e3fefc925701bd039ce10f4e70a15dcb0ad2b98398dd2ba9ad2e0b: Status 404 returned error can't find the container with id 105f49cd42e3fefc925701bd039ce10f4e70a15dcb0ad2b98398dd2ba9ad2e0b
Jul 19 14:13:25.140142 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:25.140107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523d6618_ecfb_4ceb_941f_3a8c1c0c5f1b.slice/crio-04fc6251f5d0dc290b2ec257c5c69b49a87512767ba7a81b38e16047c8b54e0d WatchSource:0}: Error finding container 04fc6251f5d0dc290b2ec257c5c69b49a87512767ba7a81b38e16047c8b54e0d: Status 404 returned error can't find the container with id 04fc6251f5d0dc290b2ec257c5c69b49a87512767ba7a81b38e16047c8b54e0d
Jul 19 14:13:25.141623 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.141593    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2wlrr"]
Jul 19 14:13:25.145600 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:25.145550    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26409d1e_6375_465b_9c92_afad2a8cfef0.slice/crio-4dda1db42ea78b0445cdaf3bc9046f92f04209871b8bd3b81f99c34a111ba613 WatchSource:0}: Error finding container 4dda1db42ea78b0445cdaf3bc9046f92f04209871b8bd3b81f99c34a111ba613: Status 404 returned error can't find the container with id 4dda1db42ea78b0445cdaf3bc9046f92f04209871b8bd3b81f99c34a111ba613
Jul 19 14:13:25.424347 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.424318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn" event={"ID":"a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c","Type":"ContainerStarted","Data":"105f49cd42e3fefc925701bd039ce10f4e70a15dcb0ad2b98398dd2ba9ad2e0b"}
Jul 19 14:13:25.426875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.426851    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="7bb51c6e9f801e930d961d49dd4bccc91da70ab28ca772ce76f46c4dfc7d7e4c" exitCode=0
Jul 19 14:13:25.427020 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.426931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"7bb51c6e9f801e930d961d49dd4bccc91da70ab28ca772ce76f46c4dfc7d7e4c"}
Jul 19 14:13:25.432563 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.432503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t" event={"ID":"1cbd0c5e-2265-46e9-813b-e80b66a84bf0","Type":"ContainerStarted","Data":"140964e5dde82cdd0657fe9bcec0dc0c6bea0ab8108fd1f00c376423e14f6f9a"}
Jul 19 14:13:25.433607 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.433571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" event={"ID":"0bbc111b-df64-40ae-a9f4-e670d3a280e9","Type":"ContainerStarted","Data":"20756a1fcb68f4a2e20d90e2d8ff2cdb8ea86e8592bf32930df0269c72382de3"}
Jul 19 14:13:25.434573 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.434552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-79qzm" event={"ID":"4a7a8662-09de-4f65-80f7-f8cf29d56eab","Type":"ContainerStarted","Data":"fa3d97e35007947d6b39819426aca5f9c9a27ff3c4d80391d4a523a970a8d7ea"}
Jul 19 14:13:25.435515 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.435497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626" event={"ID":"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b","Type":"ContainerStarted","Data":"04fc6251f5d0dc290b2ec257c5c69b49a87512767ba7a81b38e16047c8b54e0d"}
Jul 19 14:13:25.436633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.436612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2wlrr" event={"ID":"26409d1e-6375-465b-9c92-afad2a8cfef0","Type":"ContainerStarted","Data":"4dda1db42ea78b0445cdaf3bc9046f92f04209871b8bd3b81f99c34a111ba613"}
Jul 19 14:13:25.437690 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:25.437654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf" event={"ID":"206e76a1-cbcb-47f7-8260-bfd3ec2d3a31","Type":"ContainerStarted","Data":"917a6744652a31f058d3c7d7df7c720cd58b55ee5d5b91324e5d1b283e23e175"}
Jul 19 14:13:26.454559 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.453608    2582 generic.go:356] "Generic (PLEG): container finished" podID="79cddbc8-dd39-4db8-a2fa-6336f41cf0a0" containerID="b8b734848f92b84788c5c1e6cfdb11b56129b0d60ea69f778d0ab860936d57c8" exitCode=0
Jul 19 14:13:26.456580 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.453659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerDied","Data":"b8b734848f92b84788c5c1e6cfdb11b56129b0d60ea69f778d0ab860936d57c8"}
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.755925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.755984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.756027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.756104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.756155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:26.756196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.756368    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.756451    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.756430995 +0000 UTC m=+44.040089438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.756891    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.756910    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.756958    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.756942865 +0000 UTC m=+44.040601309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757024    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757081    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.757070107 +0000 UTC m=+44.040728548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757150    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.757139872 +0000 UTC m=+44.040798300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:26.757411 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757211    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:26.758269 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757240    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.757230018 +0000 UTC m=+44.040888458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:26.758269 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757293    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:26.758269 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:26.757323    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:30.757313277 +0000 UTC m=+44.040971707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:27.470123 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:27.469994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf" event={"ID":"206e76a1-cbcb-47f7-8260-bfd3ec2d3a31","Type":"ContainerStarted","Data":"ba9c7f7070524e7d2aa0091d705cdad25646bdce91cae40547a7e55a0532f1c4"}
Jul 19 14:13:27.482544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:27.482509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" event={"ID":"79cddbc8-dd39-4db8-a2fa-6336f41cf0a0","Type":"ContainerStarted","Data":"c54529e5ae9598f61ba54c1bf13e1360227153b6cd496eccfcf459ffb9fcf56c"}
Jul 19 14:13:27.509359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:27.509297    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-r4nqf" podStartSLOduration=25.563171207 podStartE2EDuration="27.509274371s" totalImagesPullingTime="1.946103164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:27.486315034 +0000 UTC m=+40.769973509" watchObservedRunningTime="2026-07-19 14:13:27.509274371 +0000 UTC m=+40.792932817"
Jul 19 14:13:30.199625 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.199573    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2mpsx" podStartSLOduration=15.190825398 podStartE2EDuration="42.199552794s" totalImagesPullingTime="27.008727396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:27.509455986 +0000 UTC m=+40.793114425" watchObservedRunningTime="2026-07-19 14:13:30.199552794 +0000 UTC m=+43.483211239"
Jul 19 14:13:30.200210 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.200190    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"]
Jul 19 14:13:30.219136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.219112    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"]
Jul 19 14:13:30.219265 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.219215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.221560 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.221537    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 19 14:13:30.221688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.221623    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 19 14:13:30.221754 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.221739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-65gdx\""
Jul 19 14:13:30.401221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.401178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.401384 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.401268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/465147a2-7da3-4d2d-8000-40e07c15b1a2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.502123 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.502026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.502123 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.502097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/465147a2-7da3-4d2d-8000-40e07c15b1a2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.502303 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.502200    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:30.502303 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.502293    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:31.002274033 +0000 UTC m=+44.285932459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:30.502930 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.502900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/465147a2-7da3-4d2d-8000-40e07c15b1a2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:30.806012 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.805922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:30.806012 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.805979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:30.806213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.806049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:30.806213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.806098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:30.806213 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806107    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:30.806213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.806136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:30.806213 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.80616769 +0000 UTC m=+52.089826122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806243    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806265    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806317    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806318    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.806305799 +0000 UTC m=+52.089964230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806368    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.806352978 +0000 UTC m=+52.090011411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:30.806386 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806384    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.806375357 +0000 UTC m=+52.090033783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:30.806611 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806400    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.806392459 +0000 UTC m=+52.090050926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:30.806611 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:30.806449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:30.806611 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806546    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:30.806611 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806558    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:30.806611 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:30.806591    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.806583279 +0000 UTC m=+52.090241708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:31.008526 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:31.008496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:31.008747 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:31.008721    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:31.008826 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:31.008812    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:32.008788026 +0000 UTC m=+45.292446478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:32.019957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:32.019906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:32.020388 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:32.020118    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:32.020388 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:32.020187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:34.020171334 +0000 UTC m=+47.303829760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:33.500939 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.500899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn" event={"ID":"a1d1a251-809b-4f55-afbf-d2bbd6fd8a7c","Type":"ContainerStarted","Data":"a71ce4254eb9d19d9343836c5c34d0f24d36e806cbe2af84294a80e0fc266362"}
Jul 19 14:13:33.502756 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.502729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t" event={"ID":"1cbd0c5e-2265-46e9-813b-e80b66a84bf0","Type":"ContainerStarted","Data":"172e56be8adf28796f946a784ba3edcbf86e3d87a8d3d8da701dd823cbcfeb11"}
Jul 19 14:13:33.504550 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.504531    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/0.log"
Jul 19 14:13:33.504827 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.504569    2582 generic.go:356] "Generic (PLEG): container finished" podID="0bbc111b-df64-40ae-a9f4-e670d3a280e9" containerID="652bc3ec1aceea2685b04d92058155432a6a59e46049bffc683a764cfd91225d" exitCode=255
Jul 19 14:13:33.504827 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.504650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" event={"ID":"0bbc111b-df64-40ae-a9f4-e670d3a280e9","Type":"ContainerDied","Data":"652bc3ec1aceea2685b04d92058155432a6a59e46049bffc683a764cfd91225d"}
Jul 19 14:13:33.504946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.504850    2582 scope.go:117] "RemoveContainer" containerID="652bc3ec1aceea2685b04d92058155432a6a59e46049bffc683a764cfd91225d"
Jul 19 14:13:33.506858 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.506491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-79qzm" event={"ID":"4a7a8662-09de-4f65-80f7-f8cf29d56eab","Type":"ContainerStarted","Data":"27d63a98ccf23a94d7d3951a9b578a65d52f64a9e271933ee631dc101d9d6ba7"}
Jul 19 14:13:33.508222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.508201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626" event={"ID":"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b","Type":"ContainerStarted","Data":"e4ddcaf99f2ccfd8d463832cbfc72edcc710802fa9fab30e5e25927ad581745c"}
Jul 19 14:13:33.510042 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.510023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2wlrr" event={"ID":"26409d1e-6375-465b-9c92-afad2a8cfef0","Type":"ContainerStarted","Data":"d94790484ea2d910538bf4b25c9098b625b8c889bb74a1988bdeb91a79bd646b"}
Jul 19 14:13:33.517923 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.517877    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-kwqzn" podStartSLOduration=22.92755918 podStartE2EDuration="30.517860746s" totalImagesPullingTime="7.590301566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:33.516332396 +0000 UTC m=+46.799990844" watchObservedRunningTime="2026-07-19 14:13:33.517860746 +0000 UTC m=+46.801519198"
Jul 19 14:13:33.531913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.531866    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t" podStartSLOduration=24.927859136 podStartE2EDuration="32.531851029s" totalImagesPullingTime="7.603991893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:33.530848869 +0000 UTC m=+46.814507317" watchObservedRunningTime="2026-07-19 14:13:33.531851029 +0000 UTC m=+46.815509476"
Jul 19 14:13:33.572149 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.572098    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-79qzm" podStartSLOduration=25.967709341 podStartE2EDuration="33.572079039s" totalImagesPullingTime="7.604369698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:33.571696067 +0000 UTC m=+46.855354514" watchObservedRunningTime="2026-07-19 14:13:33.572079039 +0000 UTC m=+46.855737486"
Jul 19 14:13:33.604033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.603974    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626" podStartSLOduration=22.014978134 podStartE2EDuration="29.60394996s" totalImagesPullingTime="7.588971826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:33.586526942 +0000 UTC m=+46.870185389" watchObservedRunningTime="2026-07-19 14:13:33.60394996 +0000 UTC m=+46.887608408"
Jul 19 14:13:33.835307 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.835238    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2wlrr" podStartSLOduration=4.243414513 podStartE2EDuration="11.83521646s" totalImagesPullingTime="7.591801947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:33.602420315 +0000 UTC m=+46.886078762" watchObservedRunningTime="2026-07-19 14:13:33.83521646 +0000 UTC m=+47.118874906"
Jul 19 14:13:33.835603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.835561    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dfmhx"]
Jul 19 14:13:33.865421 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.865374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfmhx"]
Jul 19 14:13:33.865635 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.865500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:33.867607 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.867558    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 19 14:13:33.867804 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.867765    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 19 14:13:33.867872 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.867848    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5648\""
Jul 19 14:13:33.937513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.937481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:33.937677 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.937517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/907d760a-7cde-4836-8b56-cf2451418276-data-volume\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:33.937733 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.937661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/907d760a-7cde-4836-8b56-cf2451418276-crio-socket\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:33.937771 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.937746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wf4s\" (UniqueName: \"kubernetes.io/projected/907d760a-7cde-4836-8b56-cf2451418276-kube-api-access-7wf4s\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:33.937876 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:33.937859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.038692 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.038692 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/907d760a-7cde-4836-8b56-cf2451418276-data-volume\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.038932 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.038736    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:13:34.038932 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/907d760a-7cde-4836-8b56-cf2451418276-crio-socket\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.038932 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.038829    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:34.538791246 +0000 UTC m=+47.822449683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : configmap "kube-rbac-proxy" not found
Jul 19 14:13:34.038932 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wf4s\" (UniqueName: \"kubernetes.io/projected/907d760a-7cde-4836-8b56-cf2451418276-kube-api-access-7wf4s\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.039137 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/907d760a-7cde-4836-8b56-cf2451418276-crio-socket\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.039137 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:34.039137 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.038989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.039137 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.039050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/907d760a-7cde-4836-8b56-cf2451418276-data-volume\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.039318 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.039154    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:34.039318 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.039207    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:34.039318 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.039208    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:38.039191276 +0000 UTC m=+51.322849710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:34.039318 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.039263    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:34.539248336 +0000 UTC m=+47.822906768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:34.048403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.048377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wf4s\" (UniqueName: \"kubernetes.io/projected/907d760a-7cde-4836-8b56-cf2451418276-kube-api-access-7wf4s\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.514506 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.514478    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:13:34.514904 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.514832    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/0.log"
Jul 19 14:13:34.514904 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.514864    2582 generic.go:356] "Generic (PLEG): container finished" podID="0bbc111b-df64-40ae-a9f4-e670d3a280e9" containerID="ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3" exitCode=255
Jul 19 14:13:34.515005 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.514975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" event={"ID":"0bbc111b-df64-40ae-a9f4-e670d3a280e9","Type":"ContainerDied","Data":"ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3"}
Jul 19 14:13:34.515053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.515041    2582 scope.go:117] "RemoveContainer" containerID="652bc3ec1aceea2685b04d92058155432a6a59e46049bffc683a764cfd91225d"
Jul 19 14:13:34.515185 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.515162    2582 scope.go:117] "RemoveContainer" containerID="ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3"
Jul 19 14:13:34.515329 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.515312    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-t4k8d_openshift-console-operator(0bbc111b-df64-40ae-a9f4-e670d3a280e9)\"" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" podUID="0bbc111b-df64-40ae-a9f4-e670d3a280e9"
Jul 19 14:13:34.543498 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.543474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.543621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:34.543601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:34.543712 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.543652    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:34.543789 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.543768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:35.543735397 +0000 UTC m=+48.827393835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:34.543940 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.543911    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:13:34.544045 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:34.543974    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:35.543960814 +0000 UTC m=+48.827619248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : configmap "kube-rbac-proxy" not found
Jul 19 14:13:35.037770 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.037742    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frw6w_7c133b6d-e8fb-415c-b652-2f5c0105b298/dns-node-resolver/0.log"
Jul 19 14:13:35.464197 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.464165    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"]
Jul 19 14:13:35.504278 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.504236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"]
Jul 19 14:13:35.504436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.504367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"
Jul 19 14:13:35.506766 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.506743    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:35.506868 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.506813    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-txvsl\""
Jul 19 14:13:35.507484 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.507466    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 19 14:13:35.519869 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.519853    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:13:35.520216 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.520117    2582 scope.go:117] "RemoveContainer" containerID="ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3"
Jul 19 14:13:35.520308 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:35.520284    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-t4k8d_openshift-console-operator(0bbc111b-df64-40ae-a9f4-e670d3a280e9)\"" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" podUID="0bbc111b-df64-40ae-a9f4-e670d3a280e9"
Jul 19 14:13:35.553136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.553113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht5s5\" (UniqueName: \"kubernetes.io/projected/6f1c7dd1-b641-4510-ac82-66afcb5a79d2-kube-api-access-ht5s5\") pod \"migrator-7cc9c7ffd7-r4nn8\" (UID: \"6f1c7dd1-b641-4510-ac82-66afcb5a79d2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"
Jul 19 14:13:35.553375 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.553357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:35.553448 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:35.553430    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:35.553502 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:35.553476    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:37.553460394 +0000 UTC m=+50.837118821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:35.553591 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.553530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:35.553688 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:35.553655    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:13:35.553771 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:35.553720    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:37.553707918 +0000 UTC m=+50.837366343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : configmap "kube-rbac-proxy" not found
Jul 19 14:13:35.654646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.654613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht5s5\" (UniqueName: \"kubernetes.io/projected/6f1c7dd1-b641-4510-ac82-66afcb5a79d2-kube-api-access-ht5s5\") pod \"migrator-7cc9c7ffd7-r4nn8\" (UID: \"6f1c7dd1-b641-4510-ac82-66afcb5a79d2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"
Jul 19 14:13:35.661710 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.661683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht5s5\" (UniqueName: \"kubernetes.io/projected/6f1c7dd1-b641-4510-ac82-66afcb5a79d2-kube-api-access-ht5s5\") pod \"migrator-7cc9c7ffd7-r4nn8\" (UID: \"6f1c7dd1-b641-4510-ac82-66afcb5a79d2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"
Jul 19 14:13:35.813600 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.813521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"
Jul 19 14:13:35.963739 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:35.963703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8"]
Jul 19 14:13:35.966765 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:35.966740    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1c7dd1_b641_4510_ac82_66afcb5a79d2.slice/crio-8c33230a513c1aea063ab303a1c7a83694936130e700bd63c46ca8f17cb25097 WatchSource:0}: Error finding container 8c33230a513c1aea063ab303a1c7a83694936130e700bd63c46ca8f17cb25097: Status 404 returned error can't find the container with id 8c33230a513c1aea063ab303a1c7a83694936130e700bd63c46ca8f17cb25097
Jul 19 14:13:36.240883 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:36.240856    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nj6tn_7d3707c1-d4dc-4c14-8ba3-164704dbfc9e/node-ca/0.log"
Jul 19 14:13:36.524196 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:36.524120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8" event={"ID":"6f1c7dd1-b641-4510-ac82-66afcb5a79d2","Type":"ContainerStarted","Data":"8c33230a513c1aea063ab303a1c7a83694936130e700bd63c46ca8f17cb25097"}
Jul 19 14:13:36.638535 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:36.638509    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2wlrr_26409d1e-6375-465b-9c92-afad2a8cfef0/serve-healthcheck-canary/0.log"
Jul 19 14:13:37.574289 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:37.574256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:37.574642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:37.574316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:37.574642 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:37.574404    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:37.574642 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:37.574440    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 19 14:13:37.574642 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:37.574476    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:41.574456289 +0000 UTC m=+54.858114712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:37.574642 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:37.574493    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:41.57448603 +0000 UTC m=+54.858144454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : configmap "kube-rbac-proxy" not found
Jul 19 14:13:38.079157 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.079124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:38.079337 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.079275    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:38.079376 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.079343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:46.079329015 +0000 UTC m=+59.362987442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:38.531893 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.531853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8" event={"ID":"6f1c7dd1-b641-4510-ac82-66afcb5a79d2","Type":"ContainerStarted","Data":"c109c9697be2400871114717e657b184ff4ac5b042ecaa8656ed27f55801e6ba"}
Jul 19 14:13:38.532076 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.531916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8" event={"ID":"6f1c7dd1-b641-4510-ac82-66afcb5a79d2","Type":"ContainerStarted","Data":"e4835b98fb3c7b802335ac89e6602f0300296308c27016af648571ff30f41550"}
Jul 19 14:13:38.550299 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.550239    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r4nn8" podStartSLOduration=1.847001739 podStartE2EDuration="3.550222177s" totalImagesPullingTime="1.703220438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:38.549532963 +0000 UTC m=+51.833191410" watchObservedRunningTime="2026-07-19 14:13:38.550222177 +0000 UTC m=+51.833880624"
Jul 19 14:13:38.887492 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887613    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887708    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls podName:aedaacdf-446f-4dda-8e99-44027d5f8322 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.887686642 +0000 UTC m=+68.171345084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls") pod "dns-default-vlgrp" (UID: "aedaacdf-446f-4dda-8e99-44027d5f8322") : secret "dns-default-metrics-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887713    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887716    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887733    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887750    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk: secret "image-registry-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887713    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:38.887733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887761    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls podName:547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.88774632 +0000 UTC m=+68.171404747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nmlm7" (UID: "547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0") : secret "samples-operator-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887819    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.887805918 +0000 UTC m=+68.171464354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : secret "router-metrics-certs-default" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887834    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls podName:606c96ed-d9f4-4c84-9d57-8c37918fa3e7 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.8878249 +0000 UTC m=+68.171483324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls") pod "image-registry-7f9dc7cc4b-tgtsk" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7") : secret "image-registry-tls" not found
Jul 19 14:13:38.887945 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887848    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls podName:76530044-a09f-46e4-9872-c0ff1cd72546 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.887841034 +0000 UTC m=+68.171499466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqtk7" (UID: "76530044-a09f-46e4-9872-c0ff1cd72546") : secret "cluster-monitoring-operator-tls" not found
Jul 19 14:13:38.888526 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:38.887863    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle podName:746525da-4951-4c57-9f42-3725407eeb15 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:54.887855796 +0000 UTC m=+68.171514221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle") pod "router-default-7944cdf68-hkq2v" (UID: "746525da-4951-4c57-9f42-3725407eeb15") : configmap references non-existent config key: service-ca.crt
Jul 19 14:13:41.613926 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:41.613887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:41.614361 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:41.613960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:41.614361 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:41.614057    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:41.614361 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:41.614155    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls podName:907d760a-7cde-4836-8b56-cf2451418276 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:49.61413387 +0000 UTC m=+62.897792296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dfmhx" (UID: "907d760a-7cde-4836-8b56-cf2451418276") : secret "insights-runtime-extractor-tls" not found
Jul 19 14:13:41.614600 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:41.614568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/907d760a-7cde-4836-8b56-cf2451418276-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:43.350221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:43.350169    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:43.350221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:43.350239    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:43.350755 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:43.350581    2582 scope.go:117] "RemoveContainer" containerID="ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3"
Jul 19 14:13:43.350755 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:43.350746    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-t4k8d_openshift-console-operator(0bbc111b-df64-40ae-a9f4-e670d3a280e9)\"" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" podUID="0bbc111b-df64-40ae-a9f4-e670d3a280e9"
Jul 19 14:13:46.158649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:46.158595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:13:46.159069 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:46.158770    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 19 14:13:46.159069 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:13:46.158861    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert podName:465147a2-7da3-4d2d-8000-40e07c15b1a2 nodeName:}" failed. No retries permitted until 2026-07-19 14:14:02.158845017 +0000 UTC m=+75.442503441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-r45l4" (UID: "465147a2-7da3-4d2d-8000-40e07c15b1a2") : secret "networking-console-plugin-cert" not found
Jul 19 14:13:48.422321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:48.422291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nxvzm"
Jul 19 14:13:49.689399 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:49.689356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:49.691703 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:49.691659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/907d760a-7cde-4836-8b56-cf2451418276-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dfmhx\" (UID: \"907d760a-7cde-4836-8b56-cf2451418276\") " pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:49.777412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:49.777383    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5648\""
Jul 19 14:13:49.786036 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:49.786011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dfmhx"
Jul 19 14:13:49.912687 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:49.912647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dfmhx"]
Jul 19 14:13:49.915333 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:49.915311    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907d760a_7cde_4836_8b56_cf2451418276.slice/crio-8b0eb1d500dd7c34c2b867d521213fec2ce675bc19591428d499ef3f06ebb161 WatchSource:0}: Error finding container 8b0eb1d500dd7c34c2b867d521213fec2ce675bc19591428d499ef3f06ebb161: Status 404 returned error can't find the container with id 8b0eb1d500dd7c34c2b867d521213fec2ce675bc19591428d499ef3f06ebb161
Jul 19 14:13:50.576309 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:50.576230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfmhx" event={"ID":"907d760a-7cde-4836-8b56-cf2451418276","Type":"ContainerStarted","Data":"8b0eb1d500dd7c34c2b867d521213fec2ce675bc19591428d499ef3f06ebb161"}
Jul 19 14:13:52.924900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:52.924849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:52.925333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:52.924967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:52.927212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:52.927187    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:13:52.927860 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:52.927836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/7d4219cc-0fc6-4f16-b73d-623acd6d6fa5-kube-api-access-ctl7k\") pod \"network-check-target-69fkk\" (UID: \"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5\") " pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:52.937764 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:52.937741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d73e2c3-ebcf-4cd5-a26d-37224fb4880f-metrics-certs\") pod \"network-metrics-daemon-8pdkq\" (UID: \"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f\") " pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:53.026260 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.026220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:53.028595 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.028574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:13:53.039889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.039834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/235f95e3-d77f-46f7-a93f-47e3f0836278-original-pull-secret\") pod \"global-pull-secret-syncer-c7l6c\" (UID: \"235f95e3-d77f-46f7-a93f-47e3f0836278\") " pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:53.055885 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.055861    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hzhh\""
Jul 19 14:13:53.061334 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.061316    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7cp9\""
Jul 19 14:13:53.063950 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.063931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:53.066198 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.066178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7l6c"
Jul 19 14:13:53.070050 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:53.070030    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pdkq"
Jul 19 14:13:54.798350 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.798273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pdkq"]
Jul 19 14:13:54.801207 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:54.801178    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d73e2c3_ebcf_4cd5_a26d_37224fb4880f.slice/crio-4e1d4e9ca08cc7ab10a0507f0b9428c6a293a6b1fa38a34a6b5ad6165573a8fa WatchSource:0}: Error finding container 4e1d4e9ca08cc7ab10a0507f0b9428c6a293a6b1fa38a34a6b5ad6165573a8fa: Status 404 returned error can't find the container with id 4e1d4e9ca08cc7ab10a0507f0b9428c6a293a6b1fa38a34a6b5ad6165573a8fa
Jul 19 14:13:54.841593 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.841546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69fkk"]
Jul 19 14:13:54.842021 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:54.841999    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4219cc_0fc6_4f16_b73d_623acd6d6fa5.slice/crio-0023a817c126c8b86da361b1502917ab75322d85363578a97650c01d124dbbb2 WatchSource:0}: Error finding container 0023a817c126c8b86da361b1502917ab75322d85363578a97650c01d124dbbb2: Status 404 returned error can't find the container with id 0023a817c126c8b86da361b1502917ab75322d85363578a97650c01d124dbbb2
Jul 19 14:13:54.942557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:54.942683 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:54.942683 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:54.942683 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:54.942846 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:54.942846 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.942734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:54.943620 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.943592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/746525da-4951-4c57-9f42-3725407eeb15-service-ca-bundle\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:54.945058 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.945029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/746525da-4951-4c57-9f42-3725407eeb15-metrics-certs\") pod \"router-default-7944cdf68-hkq2v\" (UID: \"746525da-4951-4c57-9f42-3725407eeb15\") " pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:54.945058 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.945051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76530044-a09f-46e4-9872-c0ff1cd72546-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqtk7\" (UID: \"76530044-a09f-46e4-9872-c0ff1cd72546\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:54.945193 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.945177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nmlm7\" (UID: \"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:54.945281 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.945255    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aedaacdf-446f-4dda-8e99-44027d5f8322-metrics-tls\") pod \"dns-default-vlgrp\" (UID: \"aedaacdf-446f-4dda-8e99-44027d5f8322\") " pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:54.945544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:54.945480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"image-registry-7f9dc7cc4b-tgtsk\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") " pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:55.024102 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.024072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7l6c"]
Jul 19 14:13:55.027390 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:55.027367    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235f95e3_d77f_46f7_a93f_47e3f0836278.slice/crio-5d40c5cb6b224b3fdab7d873940efacf8aab46e539c3a5149afb2b12b7b0ce0e WatchSource:0}: Error finding container 5d40c5cb6b224b3fdab7d873940efacf8aab46e539c3a5149afb2b12b7b0ce0e: Status 404 returned error can't find the container with id 5d40c5cb6b224b3fdab7d873940efacf8aab46e539c3a5149afb2b12b7b0ce0e
Jul 19 14:13:55.129305 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.129276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wdxhg\""
Jul 19 14:13:55.138186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.138157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"
Jul 19 14:13:55.141277 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.141256    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-knpqf\""
Jul 19 14:13:55.149608 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.149579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:55.159185 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.159155    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-77n8w\""
Jul 19 14:13:55.166630 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.166614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:55.172927 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.172871    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d56br\""
Jul 19 14:13:55.181251 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.181226    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"
Jul 19 14:13:55.204593 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.204563    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n7vcv\""
Jul 19 14:13:55.212536 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.212504    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:13:55.342542 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.338811    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7"]
Jul 19 14:13:55.389754 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.389685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:13:55.392156 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:55.392114    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606c96ed_d9f4_4c84_9d57_8c37918fa3e7.slice/crio-6c9a1bff2dfc8fb927ff7afd9e5caa4d72fcf6505dd78e75acf126f2ca55a4f3 WatchSource:0}: Error finding container 6c9a1bff2dfc8fb927ff7afd9e5caa4d72fcf6505dd78e75acf126f2ca55a4f3: Status 404 returned error can't find the container with id 6c9a1bff2dfc8fb927ff7afd9e5caa4d72fcf6505dd78e75acf126f2ca55a4f3
Jul 19 14:13:55.417182 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.417160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7944cdf68-hkq2v"]
Jul 19 14:13:55.425795 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:55.425722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746525da_4951_4c57_9f42_3725407eeb15.slice/crio-cc36d5ab98bd00574f4daeb7339aa1205670e7453661b4580d73b5cad6b19d32 WatchSource:0}: Error finding container cc36d5ab98bd00574f4daeb7339aa1205670e7453661b4580d73b5cad6b19d32: Status 404 returned error can't find the container with id cc36d5ab98bd00574f4daeb7339aa1205670e7453661b4580d73b5cad6b19d32
Jul 19 14:13:55.440321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.440290    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7"]
Jul 19 14:13:55.444266 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:55.444244    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76530044_a09f_46e4_9872_c0ff1cd72546.slice/crio-080fd8c39138ebac6ef838b9c9088f8d390d252f30a83ca29baf8c0b602ec3ff WatchSource:0}: Error finding container 080fd8c39138ebac6ef838b9c9088f8d390d252f30a83ca29baf8c0b602ec3ff: Status 404 returned error can't find the container with id 080fd8c39138ebac6ef838b9c9088f8d390d252f30a83ca29baf8c0b602ec3ff
Jul 19 14:13:55.457516 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.457491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vlgrp"]
Jul 19 14:13:55.461107 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:13:55.461078    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaedaacdf_446f_4dda_8e99_44027d5f8322.slice/crio-47d68d64ba998ded8e589a9829ef18c81edb920e3d4ec60a02c43774f9c12765 WatchSource:0}: Error finding container 47d68d64ba998ded8e589a9829ef18c81edb920e3d4ec60a02c43774f9c12765: Status 404 returned error can't find the container with id 47d68d64ba998ded8e589a9829ef18c81edb920e3d4ec60a02c43774f9c12765
Jul 19 14:13:55.598093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.598010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfmhx" event={"ID":"907d760a-7cde-4836-8b56-cf2451418276","Type":"ContainerStarted","Data":"51c9768968a430e4035e14844435db950ad2c4f9acdaa28caf3f5e7cca89687e"}
Jul 19 14:13:55.601392 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.601363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7944cdf68-hkq2v" event={"ID":"746525da-4951-4c57-9f42-3725407eeb15","Type":"ContainerStarted","Data":"dc21cb95bc2215cfdd68f8dacf7b1b5e0a5076d74b401215bf0b2c36a453aa05"}
Jul 19 14:13:55.601527 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.601415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7944cdf68-hkq2v" event={"ID":"746525da-4951-4c57-9f42-3725407eeb15","Type":"ContainerStarted","Data":"cc36d5ab98bd00574f4daeb7339aa1205670e7453661b4580d73b5cad6b19d32"}
Jul 19 14:13:55.602823 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.602794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pdkq" event={"ID":"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f","Type":"ContainerStarted","Data":"4e1d4e9ca08cc7ab10a0507f0b9428c6a293a6b1fa38a34a6b5ad6165573a8fa"}
Jul 19 14:13:55.605851 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.605791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7l6c" event={"ID":"235f95e3-d77f-46f7-a93f-47e3f0836278","Type":"ContainerStarted","Data":"5d40c5cb6b224b3fdab7d873940efacf8aab46e539c3a5149afb2b12b7b0ce0e"}
Jul 19 14:13:55.607185 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.607161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlgrp" event={"ID":"aedaacdf-446f-4dda-8e99-44027d5f8322","Type":"ContainerStarted","Data":"47d68d64ba998ded8e589a9829ef18c81edb920e3d4ec60a02c43774f9c12765"}
Jul 19 14:13:55.609574 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.609476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" event={"ID":"606c96ed-d9f4-4c84-9d57-8c37918fa3e7","Type":"ContainerStarted","Data":"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"}
Jul 19 14:13:55.609574 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.609522    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:13:55.609574 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.609542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" event={"ID":"606c96ed-d9f4-4c84-9d57-8c37918fa3e7","Type":"ContainerStarted","Data":"6c9a1bff2dfc8fb927ff7afd9e5caa4d72fcf6505dd78e75acf126f2ca55a4f3"}
Jul 19 14:13:55.612110 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.612037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69fkk" event={"ID":"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5","Type":"ContainerStarted","Data":"cdb665bac60e2e3caeaad25bb989d3b5860930b76bf7bcef5daee4dd9ffcca9b"}
Jul 19 14:13:55.612110 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.612075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69fkk" event={"ID":"7d4219cc-0fc6-4f16-b73d-623acd6d6fa5","Type":"ContainerStarted","Data":"0023a817c126c8b86da361b1502917ab75322d85363578a97650c01d124dbbb2"}
Jul 19 14:13:55.612315 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.612286    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:13:55.613874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.613846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7" event={"ID":"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0","Type":"ContainerStarted","Data":"32828775e971889991c86d4263e481cdce07e87c8934dd8bf8de1d52c6bce355"}
Jul 19 14:13:55.615198 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.615175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7" event={"ID":"76530044-a09f-46e4-9872-c0ff1cd72546","Type":"ContainerStarted","Data":"080fd8c39138ebac6ef838b9c9088f8d390d252f30a83ca29baf8c0b602ec3ff"}
Jul 19 14:13:55.620472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.620428    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7944cdf68-hkq2v" podStartSLOduration=55.620400885 podStartE2EDuration="55.620400885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:55.619093381 +0000 UTC m=+68.902751827" watchObservedRunningTime="2026-07-19 14:13:55.620400885 +0000 UTC m=+68.904059334"
Jul 19 14:13:55.633733 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.633678    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-69fkk" podStartSLOduration=67.633647779 podStartE2EDuration="1m7.633647779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:55.632725343 +0000 UTC m=+68.916383791" watchObservedRunningTime="2026-07-19 14:13:55.633647779 +0000 UTC m=+68.917306227"
Jul 19 14:13:55.650433 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:55.650034    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" podStartSLOduration=67.650016112 podStartE2EDuration="1m7.650016112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:55.64899676 +0000 UTC m=+68.932655209" watchObservedRunningTime="2026-07-19 14:13:55.650016112 +0000 UTC m=+68.933674559"
Jul 19 14:13:56.169222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.167722    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:56.171763 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.171170    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:56.242090 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.241698    2582 scope.go:117] "RemoveContainer" containerID="ea5faff75f399c0545e4d413eb614e505f3fd9cb0999014a5903a77b4c88f5a3"
Jul 19 14:13:56.624762 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.624029    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:13:56.629136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.625404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" event={"ID":"0bbc111b-df64-40ae-a9f4-e670d3a280e9","Type":"ContainerStarted","Data":"fb292320e5a89e461d7f08d62bdf4878a98b209e31513d287840a429350abb1c"}
Jul 19 14:13:56.629136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.627473    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:56.629136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.627513    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:56.629648 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.629597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7944cdf68-hkq2v"
Jul 19 14:13:56.643115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:56.641418    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d" podStartSLOduration=49.01075016 podStartE2EDuration="56.641391048s" totalImagesPullingTime="7.630640888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:56.640492055 +0000 UTC m=+69.924150513" watchObservedRunningTime="2026-07-19 14:13:56.641391048 +0000 UTC m=+69.925049487"
Jul 19 14:13:57.398372 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:57.398236    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-t4k8d"
Jul 19 14:13:57.630848 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:13:57.630809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pdkq" event={"ID":"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f","Type":"ContainerStarted","Data":"c2521c21431758f2affb29b50b3a8a0169fe4ab8a5ab53b06b299710cb77ae10"}
Jul 19 14:14:02.221072 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.221026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:14:02.223782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.223753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/465147a2-7da3-4d2d-8000-40e07c15b1a2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-r45l4\" (UID: \"465147a2-7da3-4d2d-8000-40e07c15b1a2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:14:02.330214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.330174    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-65gdx\""
Jul 19 14:14:02.338122 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.338098    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"
Jul 19 14:14:02.627752 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.627560    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4"]
Jul 19 14:14:02.654452 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.654420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pdkq" event={"ID":"1d73e2c3-ebcf-4cd5-a26d-37224fb4880f","Type":"ContainerStarted","Data":"5e98c774338dd9867f2e832beb2710476738c8c110737cb90a2cad473ec7b494"}
Jul 19 14:14:02.655939 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.655883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4" event={"ID":"465147a2-7da3-4d2d-8000-40e07c15b1a2","Type":"ContainerStarted","Data":"61060c75961f100c95207080c9492dd0895049523e24e41deadd9a7dea030153"}
Jul 19 14:14:02.657870 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.657841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7" event={"ID":"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0","Type":"ContainerStarted","Data":"8f68ff32c80f4e7a13dd4b7a03729c8508ed5dc94ca91e70196baa54220d84b5"}
Jul 19 14:14:02.670744 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:02.670635    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8pdkq" podStartSLOduration=72.173925133 podStartE2EDuration="1m14.670616298s" totalImagesPullingTime="2.496691165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:02.668942476 +0000 UTC m=+75.952600935" watchObservedRunningTime="2026-07-19 14:14:02.670616298 +0000 UTC m=+75.954274747"
Jul 19 14:14:03.663941 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.663906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlgrp" event={"ID":"aedaacdf-446f-4dda-8e99-44027d5f8322","Type":"ContainerStarted","Data":"f523cfa543ea6fca756da9ca17b433e3daba9ec0b4b9a2c94f6241221e14da11"}
Jul 19 14:14:03.664372 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.663956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vlgrp" event={"ID":"aedaacdf-446f-4dda-8e99-44027d5f8322","Type":"ContainerStarted","Data":"3695652d782db8a22c9fc58d6d29f0b69fcf149b8926a1a62206b379c10f8bb4"}
Jul 19 14:14:03.664372 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.664092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:14:03.665723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.665696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7" event={"ID":"547ed9fb-8f85-4c3c-bf9e-1817c1d1fbf0","Type":"ContainerStarted","Data":"b69a676b63e9cf2f515566b86a280d7cbec0c3b2a80a1858a0c4c02d327851f5"}
Jul 19 14:14:03.667330 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.667307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfmhx" event={"ID":"907d760a-7cde-4836-8b56-cf2451418276","Type":"ContainerStarted","Data":"696240c9e959459ce1306c5ea636876c9e2c5f271a01a9f4bfdd87d8216fbe3b"}
Jul 19 14:14:03.668633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.668610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7" event={"ID":"76530044-a09f-46e4-9872-c0ff1cd72546","Type":"ContainerStarted","Data":"e62ec302a6754131bdd7ec48580d3d76be97dfbf36dfb239ecb260f4100b2768"}
Jul 19 14:14:03.670009 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.669988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7l6c" event={"ID":"235f95e3-d77f-46f7-a93f-47e3f0836278","Type":"ContainerStarted","Data":"fca6efd0e935a6ef276919b7c969e11ef53e7b379f7dabb4a82018e5f2ea9fcc"}
Jul 19 14:14:03.682261 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.682211    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vlgrp" podStartSLOduration=34.781094927 podStartE2EDuration="41.682195822s" totalImagesPullingTime="6.901100895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:03.681096325 +0000 UTC m=+76.964754771" watchObservedRunningTime="2026-07-19 14:14:03.682195822 +0000 UTC m=+76.965854354"
Jul 19 14:14:03.701545 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.701369    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqtk7" podStartSLOduration=56.66662543 podStartE2EDuration="1m3.701347581s" totalImagesPullingTime="7.034722151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:03.694798016 +0000 UTC m=+76.978456462" watchObservedRunningTime="2026-07-19 14:14:03.701347581 +0000 UTC m=+76.985006030"
Jul 19 14:14:03.712294 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.712243    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nmlm7" podStartSLOduration=56.649335321 podStartE2EDuration="1m3.71222729s" totalImagesPullingTime="7.062891969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:03.711097142 +0000 UTC m=+76.994755604" watchObservedRunningTime="2026-07-19 14:14:03.71222729 +0000 UTC m=+76.995885735"
Jul 19 14:14:03.725780 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:03.725733    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c7l6c" podStartSLOduration=68.266835332 podStartE2EDuration="1m15.7257186s" totalImagesPullingTime="7.458883268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:03.72487967 +0000 UTC m=+77.008538118" watchObservedRunningTime="2026-07-19 14:14:03.7257186 +0000 UTC m=+77.009377036"
Jul 19 14:14:04.677236 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:04.677197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4" event={"ID":"465147a2-7da3-4d2d-8000-40e07c15b1a2","Type":"ContainerStarted","Data":"ffcae3005f7220d2eb9cc94fba5a7bb7ac9013ba1e004d21324a4e7899fdcf49"}
Jul 19 14:14:04.691824 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:04.691722    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-r45l4" podStartSLOduration=32.886939452 podStartE2EDuration="34.691704597s" totalImagesPullingTime="1.804765145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:04.691200623 +0000 UTC m=+77.974859071" watchObservedRunningTime="2026-07-19 14:14:04.691704597 +0000 UTC m=+77.975363040"
Jul 19 14:14:08.696183 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:08.696145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dfmhx" event={"ID":"907d760a-7cde-4836-8b56-cf2451418276","Type":"ContainerStarted","Data":"66d321460d7005275893bac205e441280ee1869cd5e936c002ea05c32c3afb06"}
Jul 19 14:14:08.712568 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:08.712494    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dfmhx" podStartSLOduration=18.209963333 podStartE2EDuration="35.712477361s" totalImagesPullingTime="17.502514028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:08.710692383 +0000 UTC m=+81.994350827" watchObservedRunningTime="2026-07-19 14:14:08.712477361 +0000 UTC m=+81.996135809"
Jul 19 14:14:13.680657 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:13.680547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vlgrp"
Jul 19 14:14:15.154097 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:15.154057    2582 patch_prober.go:28] interesting pod/image-registry-7f9dc7cc4b-tgtsk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 19 14:14:15.154459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:15.154112    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:14:16.632997 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:16.632966    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:14:18.809169 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:18.809133    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:14:24.610426 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.610390    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-427hq"]
Jul 19 14:14:24.615329 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.615300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.617576 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.617553    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6d9j7\""
Jul 19 14:14:24.617837 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.617819    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 19 14:14:24.618044 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.618028    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 19 14:14:24.618225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.618203    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 19 14:14:24.618302 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.618235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 19 14:14:24.698502 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-accelerators-collector-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698502 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-root\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-metrics-client-ca\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698707    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-sys\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjdjf\" (UniqueName: \"kubernetes.io/projected/c72efba9-33f6-4410-befd-ba0ee4409745-kube-api-access-jjdjf\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-wtmp\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.698889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.698777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-textfile\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-metrics-client-ca\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-sys\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjdjf\" (UniqueName: \"kubernetes.io/projected/c72efba9-33f6-4410-befd-ba0ee4409745-kube-api-access-jjdjf\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-wtmp\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-textfile\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-sys\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-accelerators-collector-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-root\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799514    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-wtmp\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-textfile\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799912 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:14:24.799835    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 19 14:14:24.799912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c72efba9-33f6-4410-befd-ba0ee4409745-root\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.799912 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:14:24.799896    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls podName:c72efba9-33f6-4410-befd-ba0ee4409745 nodeName:}" failed. No retries permitted until 2026-07-19 14:14:25.29987676 +0000 UTC m=+98.583535188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls") pod "node-exporter-427hq" (UID: "c72efba9-33f6-4410-befd-ba0ee4409745") : secret "node-exporter-tls" not found
Jul 19 14:14:24.799912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.799902    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-metrics-client-ca\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.800428 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.800405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-accelerators-collector-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.802233 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.802206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:24.809686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:24.809624    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjdjf\" (UniqueName: \"kubernetes.io/projected/c72efba9-33f6-4410-befd-ba0ee4409745-kube-api-access-jjdjf\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:25.305149 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:25.305114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:25.307398 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:25.307370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c72efba9-33f6-4410-befd-ba0ee4409745-node-exporter-tls\") pod \"node-exporter-427hq\" (UID: \"c72efba9-33f6-4410-befd-ba0ee4409745\") " pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:25.525161 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:25.525123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-427hq"
Jul 19 14:14:25.597290 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:14:25.597251    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72efba9_33f6_4410_befd_ba0ee4409745.slice/crio-600ed4b2411b3cca78db85251db4c1e887b26af1d22b191fc62fccf592e832af WatchSource:0}: Error finding container 600ed4b2411b3cca78db85251db4c1e887b26af1d22b191fc62fccf592e832af: Status 404 returned error can't find the container with id 600ed4b2411b3cca78db85251db4c1e887b26af1d22b191fc62fccf592e832af
Jul 19 14:14:25.761152 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:25.761114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-427hq" event={"ID":"c72efba9-33f6-4410-befd-ba0ee4409745","Type":"ContainerStarted","Data":"600ed4b2411b3cca78db85251db4c1e887b26af1d22b191fc62fccf592e832af"}
Jul 19 14:14:26.627851 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:26.627818    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-69fkk"
Jul 19 14:14:27.774310 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:27.774278    2582 generic.go:356] "Generic (PLEG): container finished" podID="c72efba9-33f6-4410-befd-ba0ee4409745" containerID="81152219892fc1249840c40645cadc4525afcb6fad7a5087714845570484ac18" exitCode=0
Jul 19 14:14:27.774796 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:27.774340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-427hq" event={"ID":"c72efba9-33f6-4410-befd-ba0ee4409745","Type":"ContainerDied","Data":"81152219892fc1249840c40645cadc4525afcb6fad7a5087714845570484ac18"}
Jul 19 14:14:28.780121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:28.780084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-427hq" event={"ID":"c72efba9-33f6-4410-befd-ba0ee4409745","Type":"ContainerStarted","Data":"b0654cbda538d0c48a19692668402a6334e2fef6254c5111c214cb9d5bb01b54"}
Jul 19 14:14:28.780526 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:28.780165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-427hq" event={"ID":"c72efba9-33f6-4410-befd-ba0ee4409745","Type":"ContainerStarted","Data":"a3e523c42b8154c1b05262a1e66f5bf9861849874d8a8b2a1b80b79811c04f21"}
Jul 19 14:14:28.797737 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:28.797652    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-427hq" podStartSLOduration=3.247258501 podStartE2EDuration="4.797637363s" totalImagesPullingTime="1.441142378s" totalInitContainerRuntime="109.236484ms" isStatefulPod=true podCreationTimestamp="2026-07-19 14:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:28.796722081 +0000 UTC m=+102.080380528" watchObservedRunningTime="2026-07-19 14:14:28.797637363 +0000 UTC m=+102.081295837"
Jul 19 14:14:29.369881 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.369850    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:14:29.372631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.372605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.375075 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.375039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 19 14:14:29.375441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.375423    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 19 14:14:29.376169 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.376153    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm486\""
Jul 19 14:14:29.377153 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.376979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 19 14:14:29.377153 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.377052    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 19 14:14:29.377153 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.377102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 19 14:14:29.377358 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.377198    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 19 14:14:29.377358 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.377350    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 19 14:14:29.379181 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.379161    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"]
Jul 19 14:14:29.381222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.381199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.381222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.381221    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 19 14:14:29.384272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.384252    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xckrm\""
Jul 19 14:14:29.384477 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.384460    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 19 14:14:29.386109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.386089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:14:29.394101 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.394071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"]
Jul 19 14:14:29.439157 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/350e097a-4691-4690-a00b-be46f4b61379-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.439157 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58jgw\" (UniqueName: \"kubernetes.io/projected/350e097a-4691-4690-a00b-be46f4b61379-kube-api-access-58jgw\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczr9\" (UniqueName: \"kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.439661 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.439434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.539832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.539832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58jgw\" (UniqueName: \"kubernetes.io/projected/350e097a-4691-4690-a00b-be46f4b61379-kube-api-access-58jgw\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczr9\" (UniqueName: \"kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.539979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.540025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/350e097a-4691-4690-a00b-be46f4b61379-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.540048 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.540048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540759 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.540732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.540944 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.540878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.541094 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.541075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.541380 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.541357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.542580 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.542557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.542720 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.542644    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/350e097a-4691-4690-a00b-be46f4b61379-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.542792 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.542752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.547640 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.547619    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczr9\" (UniqueName: \"kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9\") pod \"console-67d5bcf94c-gtz8r\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") " pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.547853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.547838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58jgw\" (UniqueName: \"kubernetes.io/projected/350e097a-4691-4690-a00b-be46f4b61379-kube-api-access-58jgw\") pod \"monitoring-plugin-7b7b7bc8bf-m4kw7\" (UID: \"350e097a-4691-4690-a00b-be46f4b61379\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.684720 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.684683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:29.692022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.692000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:29.835850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.835826    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:14:29.838419 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:14:29.838384    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73385665_57aa_4e3c_b2e4_7e41da9627d8.slice/crio-0bd33ae1bd121c12b357e9071f3c72e663e280f9b7e21f9c993811d03d0cde5e WatchSource:0}: Error finding container 0bd33ae1bd121c12b357e9071f3c72e663e280f9b7e21f9c993811d03d0cde5e: Status 404 returned error can't find the container with id 0bd33ae1bd121c12b357e9071f3c72e663e280f9b7e21f9c993811d03d0cde5e
Jul 19 14:14:29.856657 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:29.856631    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"]
Jul 19 14:14:29.859555 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:14:29.859516    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350e097a_4691_4690_a00b_be46f4b61379.slice/crio-507c8330ae13c3d2a871f275e9c6bf0e52f6bb78542447ece8a6a7c4352cf673 WatchSource:0}: Error finding container 507c8330ae13c3d2a871f275e9c6bf0e52f6bb78542447ece8a6a7c4352cf673: Status 404 returned error can't find the container with id 507c8330ae13c3d2a871f275e9c6bf0e52f6bb78542447ece8a6a7c4352cf673
Jul 19 14:14:30.794316 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:30.794275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7" event={"ID":"350e097a-4691-4690-a00b-be46f4b61379","Type":"ContainerStarted","Data":"507c8330ae13c3d2a871f275e9c6bf0e52f6bb78542447ece8a6a7c4352cf673"}
Jul 19 14:14:30.796287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:30.796260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d5bcf94c-gtz8r" event={"ID":"73385665-57aa-4e3c-b2e4-7e41da9627d8","Type":"ContainerStarted","Data":"0bd33ae1bd121c12b357e9071f3c72e663e280f9b7e21f9c993811d03d0cde5e"}
Jul 19 14:14:31.802503 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:31.802424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7" event={"ID":"350e097a-4691-4690-a00b-be46f4b61379","Type":"ContainerStarted","Data":"d99d86163c1990e8f33f971d02d9f430834ea670387d4c14ad6af4dc0c28cbb7"}
Jul 19 14:14:31.802980 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:31.802787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:31.809136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:31.809110    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7"
Jul 19 14:14:31.818686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:31.818615    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m4kw7" podStartSLOduration=1.266224914 podStartE2EDuration="2.818603222s" totalImagesPullingTime="1.552378308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:31.81640132 +0000 UTC m=+105.100059765" watchObservedRunningTime="2026-07-19 14:14:31.818603222 +0000 UTC m=+105.102261668"
Jul 19 14:14:33.811188 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:33.811153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d5bcf94c-gtz8r" event={"ID":"73385665-57aa-4e3c-b2e4-7e41da9627d8","Type":"ContainerStarted","Data":"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"}
Jul 19 14:14:33.828218 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:33.828171    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67d5bcf94c-gtz8r" podStartSLOduration=1.8985672409999999 podStartE2EDuration="4.82815323s" totalImagesPullingTime="2.929585989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:33.827952029 +0000 UTC m=+107.111610475" watchObservedRunningTime="2026-07-19 14:14:33.82815323 +0000 UTC m=+107.111811676"
Jul 19 14:14:34.843921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:34.843890    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:14:39.684841 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:39.684814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:14:43.829110 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:43.829070    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerName="registry" containerID="cri-o://318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f" gracePeriod=30
Jul 19 14:14:43.853964 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:43.853938    2582 generic.go:356] "Generic (PLEG): container finished" podID="1cbd0c5e-2265-46e9-813b-e80b66a84bf0" containerID="172e56be8adf28796f946a784ba3edcbf86e3d87a8d3d8da701dd823cbcfeb11" exitCode=0
Jul 19 14:14:43.854044 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:43.854008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t" event={"ID":"1cbd0c5e-2265-46e9-813b-e80b66a84bf0","Type":"ContainerDied","Data":"172e56be8adf28796f946a784ba3edcbf86e3d87a8d3d8da701dd823cbcfeb11"}
Jul 19 14:14:43.854338 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:43.854322    2582 scope.go:117] "RemoveContainer" containerID="172e56be8adf28796f946a784ba3edcbf86e3d87a8d3d8da701dd823cbcfeb11"
Jul 19 14:14:44.081986 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.081964    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:14:44.152239 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152212    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152249    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152309    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152355    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg6lv\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152595 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152400    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152595 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152448    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152595 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca\") pod \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\" (UID: \"606c96ed-d9f4-4c84-9d57-8c37918fa3e7\") "
Jul 19 14:14:44.152791 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152640    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:14:44.152846 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.152834    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-certificates\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.153213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.153177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:14:44.155054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.155007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv" (OuterVolumeSpecName: "kube-api-access-gg6lv") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "kube-api-access-gg6lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:14:44.155054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.155007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:14:44.155212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.155096    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:14:44.155212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.155142    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:14:44.155334 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.155314    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:14:44.161432 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.161409    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "606c96ed-d9f4-4c84-9d57-8c37918fa3e7" (UID: "606c96ed-d9f4-4c84-9d57-8c37918fa3e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:14:44.254232 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254183    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg6lv\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-kube-api-access-gg6lv\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254232 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254208    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-image-registry-private-configuration\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254232 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254222    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-registry-tls\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254235    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-trusted-ca\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254248    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-installation-pull-secrets\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254261    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-bound-sa-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.254403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.254273    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606c96ed-d9f4-4c84-9d57-8c37918fa3e7-ca-trust-extracted\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:14:44.859005 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.858976    2582 generic.go:356] "Generic (PLEG): container finished" podID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerID="318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f" exitCode=0
Jul 19 14:14:44.859321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.859019    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"
Jul 19 14:14:44.859321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.859057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" event={"ID":"606c96ed-d9f4-4c84-9d57-8c37918fa3e7","Type":"ContainerDied","Data":"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"}
Jul 19 14:14:44.859321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.859101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk" event={"ID":"606c96ed-d9f4-4c84-9d57-8c37918fa3e7","Type":"ContainerDied","Data":"6c9a1bff2dfc8fb927ff7afd9e5caa4d72fcf6505dd78e75acf126f2ca55a4f3"}
Jul 19 14:14:44.859321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.859124    2582 scope.go:117] "RemoveContainer" containerID="318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"
Jul 19 14:14:44.861013 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.860991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-v6h5t" event={"ID":"1cbd0c5e-2265-46e9-813b-e80b66a84bf0","Type":"ContainerStarted","Data":"20f3d1d06df6a310a016f8adfdc1632a9a4396295b1f913a652123280cabba76"}
Jul 19 14:14:44.867686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.867653    2582 scope.go:117] "RemoveContainer" containerID="318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"
Jul 19 14:14:44.867932 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:14:44.867914    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f\": container with ID starting with 318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f not found: ID does not exist" containerID="318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"
Jul 19 14:14:44.867979 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.867938    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f"} err="failed to get container status \"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f\": rpc error: code = NotFound desc = could not find container \"318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f\": container with ID starting with 318a8e3d13e2138b9e02c3ae454dfe4de06c97eb714237924a572e78ca7e614f not found: ID does not exist"
Jul 19 14:14:44.893952 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.893930    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:14:44.900887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:44.900868    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f9dc7cc4b-tgtsk"]
Jul 19 14:14:45.246866 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:45.246834    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" path="/var/lib/kubelet/pods/606c96ed-d9f4-4c84-9d57-8c37918fa3e7/volumes"
Jul 19 14:14:53.900630 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:53.900603    2582 generic.go:356] "Generic (PLEG): container finished" podID="4a7a8662-09de-4f65-80f7-f8cf29d56eab" containerID="27d63a98ccf23a94d7d3951a9b578a65d52f64a9e271933ee631dc101d9d6ba7" exitCode=0
Jul 19 14:14:53.900963 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:53.900685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-79qzm" event={"ID":"4a7a8662-09de-4f65-80f7-f8cf29d56eab","Type":"ContainerDied","Data":"27d63a98ccf23a94d7d3951a9b578a65d52f64a9e271933ee631dc101d9d6ba7"}
Jul 19 14:14:53.900963 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:53.900960    2582 scope.go:117] "RemoveContainer" containerID="27d63a98ccf23a94d7d3951a9b578a65d52f64a9e271933ee631dc101d9d6ba7"
Jul 19 14:14:54.906301 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:14:54.906266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-79qzm" event={"ID":"4a7a8662-09de-4f65-80f7-f8cf29d56eab","Type":"ContainerStarted","Data":"d48210a06996404c5a63cc047ef56174b024715024e3facd425921df1d7dce66"}
Jul 19 14:15:00.843884 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:00.843831    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67d5bcf94c-gtz8r" podUID="73385665-57aa-4e3c-b2e4-7e41da9627d8" containerName="console" containerID="cri-o://0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935" gracePeriod=15
Jul 19 14:15:01.088573 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.088549    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:15:01.177961 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.177932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.177968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xczr9\" (UniqueName: \"kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178026    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178072    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178158 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle\") pod \"73385665-57aa-4e3c-b2e4-7e41da9627d8\" (UID: \"73385665-57aa-4e3c-b2e4-7e41da9627d8\") "
Jul 19 14:15:01.178539 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178505    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config" (OuterVolumeSpecName: "console-config") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:01.178539 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178524    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:01.178760 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca" (OuterVolumeSpecName: "service-ca") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:01.178760 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.178624    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:01.180371 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.180349    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:01.180371 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.180366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9" (OuterVolumeSpecName: "kube-api-access-xczr9") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "kube-api-access-xczr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:15:01.180503 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.180369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73385665-57aa-4e3c-b2e4-7e41da9627d8" (UID: "73385665-57aa-4e3c-b2e4-7e41da9627d8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:01.278782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278744    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-trusted-ca-bundle\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278775    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-serving-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278805    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xczr9\" (UniqueName: \"kubernetes.io/projected/73385665-57aa-4e3c-b2e4-7e41da9627d8-kube-api-access-xczr9\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278815    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-oauth-config\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278823    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-console-config\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278831    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-oauth-serving-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.278967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.278840    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73385665-57aa-4e3c-b2e4-7e41da9627d8-service-ca\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:15:01.933280 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.933243    2582 generic.go:356] "Generic (PLEG): container finished" podID="73385665-57aa-4e3c-b2e4-7e41da9627d8" containerID="0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935" exitCode=0
Jul 19 14:15:01.933631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.933295    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67d5bcf94c-gtz8r"
Jul 19 14:15:01.933631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.933331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d5bcf94c-gtz8r" event={"ID":"73385665-57aa-4e3c-b2e4-7e41da9627d8","Type":"ContainerDied","Data":"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"}
Jul 19 14:15:01.933631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.933385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67d5bcf94c-gtz8r" event={"ID":"73385665-57aa-4e3c-b2e4-7e41da9627d8","Type":"ContainerDied","Data":"0bd33ae1bd121c12b357e9071f3c72e663e280f9b7e21f9c993811d03d0cde5e"}
Jul 19 14:15:01.933631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.933409    2582 scope.go:117] "RemoveContainer" containerID="0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"
Jul 19 14:15:01.941385 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.941365    2582 scope.go:117] "RemoveContainer" containerID="0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"
Jul 19 14:15:01.941641 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:15:01.941624    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935\": container with ID starting with 0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935 not found: ID does not exist" containerID="0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"
Jul 19 14:15:01.941741 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.941647    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935"} err="failed to get container status \"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935\": rpc error: code = NotFound desc = could not find container \"0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935\": container with ID starting with 0e3d625c11f168d730881be375eb4599e105f0c2e5eed3b51ba7ef557b655935 not found: ID does not exist"
Jul 19 14:15:01.948602 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.948576    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:15:01.954344 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:01.954323    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67d5bcf94c-gtz8r"]
Jul 19 14:15:03.246186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:03.246153    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73385665-57aa-4e3c-b2e4-7e41da9627d8" path="/var/lib/kubelet/pods/73385665-57aa-4e3c-b2e4-7e41da9627d8/volumes"
Jul 19 14:15:08.965882 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:08.965851    2582 generic.go:356] "Generic (PLEG): container finished" podID="523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b" containerID="e4ddcaf99f2ccfd8d463832cbfc72edcc710802fa9fab30e5e25927ad581745c" exitCode=0
Jul 19 14:15:08.966192 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:08.965922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626" event={"ID":"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b","Type":"ContainerDied","Data":"e4ddcaf99f2ccfd8d463832cbfc72edcc710802fa9fab30e5e25927ad581745c"}
Jul 19 14:15:08.966240 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:08.966227    2582 scope.go:117] "RemoveContainer" containerID="e4ddcaf99f2ccfd8d463832cbfc72edcc710802fa9fab30e5e25927ad581745c"
Jul 19 14:15:09.970986 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:09.970951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-58626" event={"ID":"523d6618-ecfb-4ceb-941f-3a8c1c0c5f1b","Type":"ContainerStarted","Data":"1c9ac9beed88e3f75786fa70489617d64944e2dc47eeea9ecb3afb75624d88d7"}
Jul 19 14:15:57.604635 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.604595    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.604996    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerName="registry"
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.605011    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerName="registry"
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.605022    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73385665-57aa-4e3c-b2e4-7e41da9627d8" containerName="console"
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.605030    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73385665-57aa-4e3c-b2e4-7e41da9627d8" containerName="console"
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.605084    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="73385665-57aa-4e3c-b2e4-7e41da9627d8" containerName="console"
Jul 19 14:15:57.605170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.605095    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="606c96ed-d9f4-4c84-9d57-8c37918fa3e7" containerName="registry"
Jul 19 14:15:57.608054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.608034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.610442 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.610421    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 19 14:15:57.610547 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.610461    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 19 14:15:57.610547 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.610422    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 19 14:15:57.611369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.611336    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 19 14:15:57.611369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.611367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 19 14:15:57.611562 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.611354    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 19 14:15:57.611562 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.611409    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm486\""
Jul 19 14:15:57.611717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.611703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 19 14:15:57.616188 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.616165    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 19 14:15:57.616702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.616455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:15:57.708009 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.707978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708009 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbbp4\" (UniqueName: \"kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.708235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.708198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.808951 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.808915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.808951 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.808956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbbp4\" (UniqueName: \"kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.809853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.810102 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.810102 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.809954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.811588 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.811569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.811588 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.811581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.817023 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.817004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbbp4\" (UniqueName: \"kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4\") pod \"console-5f8c994d44-t9gzn\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") " pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:57.919549 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:57.919514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:15:58.045921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:58.045801    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:15:58.048546 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:15:58.048515    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52e0b3_cd99_4474_9872_490919098769.slice/crio-26d2c7b46c601fe9e555f1a8c244af999e9dc7b1e11edd7bfaa1486402652410 WatchSource:0}: Error finding container 26d2c7b46c601fe9e555f1a8c244af999e9dc7b1e11edd7bfaa1486402652410: Status 404 returned error can't find the container with id 26d2c7b46c601fe9e555f1a8c244af999e9dc7b1e11edd7bfaa1486402652410
Jul 19 14:15:58.166331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:58.166272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c994d44-t9gzn" event={"ID":"6d52e0b3-cd99-4474-9872-490919098769","Type":"ContainerStarted","Data":"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"}
Jul 19 14:15:58.166515 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:58.166408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c994d44-t9gzn" event={"ID":"6d52e0b3-cd99-4474-9872-490919098769","Type":"ContainerStarted","Data":"26d2c7b46c601fe9e555f1a8c244af999e9dc7b1e11edd7bfaa1486402652410"}
Jul 19 14:15:58.183688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:15:58.183580    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8c994d44-t9gzn" podStartSLOduration=1.183564238 podStartE2EDuration="1.183564238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:15:58.181816095 +0000 UTC m=+191.465474540" watchObservedRunningTime="2026-07-19 14:15:58.183564238 +0000 UTC m=+191.467222683"
Jul 19 14:16:07.920749 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:16:07.920706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:16:07.921139 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:16:07.920785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:16:07.925359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:16:07.925336    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:16:08.209035 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:16:08.208957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:17:07.312149 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.312113    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"]
Jul 19 14:17:07.315381 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.315363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.317799 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.317775    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 19 14:17:07.318097 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.318079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:17:07.318286 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.318268    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-884tf\""
Jul 19 14:17:07.327795 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.327771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"]
Jul 19 14:17:07.458309 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.458275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.458495 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.458343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2w9\" (UniqueName: \"kubernetes.io/projected/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-kube-api-access-vr2w9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.559102 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.559060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.559266 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.559138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2w9\" (UniqueName: \"kubernetes.io/projected/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-kube-api-access-vr2w9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.559609 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.559591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.568110 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.568046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2w9\" (UniqueName: \"kubernetes.io/projected/4979fbb3-a45a-435b-9221-dd6e5eeffb5c-kube-api-access-vr2w9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fm4gf\" (UID: \"4979fbb3-a45a-435b-9221-dd6e5eeffb5c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.624902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.624865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"
Jul 19 14:17:07.756906 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:07.756881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf"]
Jul 19 14:17:07.759375 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:07.759348    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979fbb3_a45a_435b_9221_dd6e5eeffb5c.slice/crio-abe498507e7d9e623c2643b47273072fd699bfbb768d2a98f8d8702240091677 WatchSource:0}: Error finding container abe498507e7d9e623c2643b47273072fd699bfbb768d2a98f8d8702240091677: Status 404 returned error can't find the container with id abe498507e7d9e623c2643b47273072fd699bfbb768d2a98f8d8702240091677
Jul 19 14:17:08.421443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:08.421407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf" event={"ID":"4979fbb3-a45a-435b-9221-dd6e5eeffb5c","Type":"ContainerStarted","Data":"abe498507e7d9e623c2643b47273072fd699bfbb768d2a98f8d8702240091677"}
Jul 19 14:17:10.432846 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:10.432814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf" event={"ID":"4979fbb3-a45a-435b-9221-dd6e5eeffb5c","Type":"ContainerStarted","Data":"f592583f3747ddd37ef6f9c58e00e3a5cd3f0cba9c3525fb17718c1c0af3ca8d"}
Jul 19 14:17:10.455202 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:10.455141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fm4gf" podStartSLOduration=0.856335554 podStartE2EDuration="3.455125809s" totalImagesPullingTime="2.598790255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:10.452587902 +0000 UTC m=+263.736246349" watchObservedRunningTime="2026-07-19 14:17:10.455125809 +0000 UTC m=+263.738784257"
Jul 19 14:17:11.356737 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.356701    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mclm5"]
Jul 19 14:17:11.359975 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.359960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.362330 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.362307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 19 14:17:11.362453 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.362436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 19 14:17:11.362520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.362436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pcmmn\""
Jul 19 14:17:11.369315 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.369295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mclm5"]
Jul 19 14:17:11.493147 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.493117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.493147 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.493158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrvmb\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-kube-api-access-lrvmb\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.594579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.594548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.594756 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.594588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrvmb\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-kube-api-access-lrvmb\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.602262 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.602235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.602461 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.602439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrvmb\" (UniqueName: \"kubernetes.io/projected/24e130ec-c92a-461e-a75c-bc5b1049beb4-kube-api-access-lrvmb\") pod \"cert-manager-webhook-6486ffd997-mclm5\" (UID: \"24e130ec-c92a-461e-a75c-bc5b1049beb4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.675883 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.675854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:11.802939 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:11.802831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mclm5"]
Jul 19 14:17:11.805681 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:11.805632    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24e130ec_c92a_461e_a75c_bc5b1049beb4.slice/crio-afdb0cad954008e7de70e21e07e2e5c94cfcfec8ef4e38f18af639b776e55141 WatchSource:0}: Error finding container afdb0cad954008e7de70e21e07e2e5c94cfcfec8ef4e38f18af639b776e55141: Status 404 returned error can't find the container with id afdb0cad954008e7de70e21e07e2e5c94cfcfec8ef4e38f18af639b776e55141
Jul 19 14:17:12.441327 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:12.441291    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5" event={"ID":"24e130ec-c92a-461e-a75c-bc5b1049beb4","Type":"ContainerStarted","Data":"afdb0cad954008e7de70e21e07e2e5c94cfcfec8ef4e38f18af639b776e55141"}
Jul 19 14:17:19.468887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.468854    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"]
Jul 19 14:17:19.473160 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.473140    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.475354 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.475337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j4vh8\""
Jul 19 14:17:19.480833 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.480813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"]
Jul 19 14:17:19.562900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.562857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.563080 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.562985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fqcv\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-kube-api-access-6fqcv\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.663420 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.663380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fqcv\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-kube-api-access-6fqcv\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.663629 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.663437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.675211 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.675185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fqcv\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-kube-api-access-6fqcv\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.675332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.675191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df6f01ea-3391-4628-bad9-65346bd51247-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qssk2\" (UID: \"df6f01ea-3391-4628-bad9-65346bd51247\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.782357 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.782268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"
Jul 19 14:17:19.911290 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:19.911267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qssk2"]
Jul 19 14:17:19.913627 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:19.913596    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf6f01ea_3391_4628_bad9_65346bd51247.slice/crio-d0035577013b2ab4743b08c75d6400a6e48c21ccf20b376e7e6458a0e9dd81e9 WatchSource:0}: Error finding container d0035577013b2ab4743b08c75d6400a6e48c21ccf20b376e7e6458a0e9dd81e9: Status 404 returned error can't find the container with id d0035577013b2ab4743b08c75d6400a6e48c21ccf20b376e7e6458a0e9dd81e9
Jul 19 14:17:20.474938 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:20.474901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2" event={"ID":"df6f01ea-3391-4628-bad9-65346bd51247","Type":"ContainerStarted","Data":"d0035577013b2ab4743b08c75d6400a6e48c21ccf20b376e7e6458a0e9dd81e9"}
Jul 19 14:17:23.489506 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:23.489466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2" event={"ID":"df6f01ea-3391-4628-bad9-65346bd51247","Type":"ContainerStarted","Data":"31aa76cd46903e80ebdef7a51a856c1085dc023ba4a7947e397e1d1c6beaf617"}
Jul 19 14:17:23.503974 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:23.503928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qssk2" podStartSLOduration=1.9175458779999999 podStartE2EDuration="4.503914708s" totalImagesPullingTime="2.58636883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:23.502688349 +0000 UTC m=+276.786346785" watchObservedRunningTime="2026-07-19 14:17:23.503914708 +0000 UTC m=+276.787573154"
Jul 19 14:17:24.495678 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:24.495627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5" event={"ID":"24e130ec-c92a-461e-a75c-bc5b1049beb4","Type":"ContainerStarted","Data":"9bfe14eaf65fcb3ef8ac3034f40480c422503b5f299d9a7a4e0d9f6e4e7d0527"}
Jul 19 14:17:24.511652 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:24.511600    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5" podStartSLOduration=1.249496085 podStartE2EDuration="13.51158438s" totalImagesPullingTime="12.262088295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:24.509551553 +0000 UTC m=+277.793210023" watchObservedRunningTime="2026-07-19 14:17:24.51158438 +0000 UTC m=+277.795242826"
Jul 19 14:17:25.499688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:25.499637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:31.506810 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:31.506778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mclm5"
Jul 19 14:17:35.237999 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.237963    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"]
Jul 19 14:17:35.241326 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.241299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.243624 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.243606    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 19 14:17:35.243735 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.243625    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:17:35.244235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.244215    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9wcdt\""
Jul 19 14:17:35.254398 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.254373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"]
Jul 19 14:17:35.285564 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.285516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtbw\" (UniqueName: \"kubernetes.io/projected/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-kube-api-access-sdtbw\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.285718 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.285604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.386684 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.386623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.386836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.386724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtbw\" (UniqueName: \"kubernetes.io/projected/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-kube-api-access-sdtbw\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.387003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.386982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.395485 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.395457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtbw\" (UniqueName: \"kubernetes.io/projected/986046f0-a9cf-4b0a-b9b4-88a3b2a1e482-kube-api-access-sdtbw\") pod \"openshift-lws-operator-fd8ccff4c-8nvt9\" (UID: \"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.555532 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.555453    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"
Jul 19 14:17:35.683383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:35.683359    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9"]
Jul 19 14:17:35.685630 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:35.685605    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986046f0_a9cf_4b0a_b9b4_88a3b2a1e482.slice/crio-263b40188ca8b7bf5e7582108fc555bd04e23e529f970d9b9015bcbb888acdc9 WatchSource:0}: Error finding container 263b40188ca8b7bf5e7582108fc555bd04e23e529f970d9b9015bcbb888acdc9: Status 404 returned error can't find the container with id 263b40188ca8b7bf5e7582108fc555bd04e23e529f970d9b9015bcbb888acdc9
Jul 19 14:17:36.550160 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:36.550107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9" event={"ID":"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482","Type":"ContainerStarted","Data":"263b40188ca8b7bf5e7582108fc555bd04e23e529f970d9b9015bcbb888acdc9"}
Jul 19 14:17:38.560979 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:38.560891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9" event={"ID":"986046f0-a9cf-4b0a-b9b4-88a3b2a1e482","Type":"ContainerStarted","Data":"cb08d7b0f0142d7d92856812103fd1c3787873ece588d91a67823fc79cd2dcf5"}
Jul 19 14:17:38.576199 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:38.576150    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nvt9" podStartSLOduration=1.040821739 podStartE2EDuration="3.576135676s" totalImagesPullingTime="2.535313937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:38.57489351 +0000 UTC m=+291.858551980" watchObservedRunningTime="2026-07-19 14:17:38.576135676 +0000 UTC m=+291.859794123"
Jul 19 14:17:47.154652 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:47.154623    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:17:47.158824 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:47.158802    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:17:47.164387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:47.164369    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 19 14:17:53.529528 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.529490    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"]
Jul 19 14:17:53.531968 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.531952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.534983 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.534962    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 19 14:17:53.534983 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.534979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 19 14:17:53.535174 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.534970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-trktb\""
Jul 19 14:17:53.535174 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.535019    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 19 14:17:53.543978 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.543955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"]
Jul 19 14:17:53.634758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.634728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-metrics-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.634758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.634759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xxr6\" (UniqueName: \"kubernetes.io/projected/8ec37e7e-947c-425e-9019-2085f1e11520-kube-api-access-8xxr6\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.634967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.634829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ec37e7e-947c-425e-9019-2085f1e11520-manager-config\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.634967 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.634873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.735744 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.735710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ec37e7e-947c-425e-9019-2085f1e11520-manager-config\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.735926 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.735755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.735926 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.735806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-metrics-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.735926 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.735822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xxr6\" (UniqueName: \"kubernetes.io/projected/8ec37e7e-947c-425e-9019-2085f1e11520-kube-api-access-8xxr6\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.736448 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.736422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ec37e7e-947c-425e-9019-2085f1e11520-manager-config\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.738170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.738149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-metrics-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.738303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.738283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ec37e7e-947c-425e-9019-2085f1e11520-cert\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.746002 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.745978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xxr6\" (UniqueName: \"kubernetes.io/projected/8ec37e7e-947c-425e-9019-2085f1e11520-kube-api-access-8xxr6\") pod \"lws-controller-manager-7d56c9879c-9lbgr\" (UID: \"8ec37e7e-947c-425e-9019-2085f1e11520\") " pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.841458 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.841377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:53.990597 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.990571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"]
Jul 19 14:17:53.993125 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:53.993088    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec37e7e_947c_425e_9019_2085f1e11520.slice/crio-fd4061e21797c626b30450db5533d3afadd636d692c431b7f578301801d1f51c WatchSource:0}: Error finding container fd4061e21797c626b30450db5533d3afadd636d692c431b7f578301801d1f51c: Status 404 returned error can't find the container with id fd4061e21797c626b30450db5533d3afadd636d692c431b7f578301801d1f51c
Jul 19 14:17:53.995128 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:53.995115    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:17:54.629538 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:54.629498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr" event={"ID":"8ec37e7e-947c-425e-9019-2085f1e11520","Type":"ContainerStarted","Data":"fd4061e21797c626b30450db5533d3afadd636d692c431b7f578301801d1f51c"}
Jul 19 14:17:55.636093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:55.636052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr" event={"ID":"8ec37e7e-947c-425e-9019-2085f1e11520","Type":"ContainerStarted","Data":"55c3a6a5e2abd077e973cbecebe9789fc7b4e98a3668e3545a0741b7b969df85"}
Jul 19 14:17:55.636594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:55.636155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:17:55.650786 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:55.650742    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr" podStartSLOduration=1.11286057 podStartE2EDuration="2.650726428s" totalImagesPullingTime="1.537865858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:55.649936753 +0000 UTC m=+308.933595200" watchObservedRunningTime="2026-07-19 14:17:55.650726428 +0000 UTC m=+308.934384873"
Jul 19 14:17:56.266291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.266257    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"]
Jul 19 14:17:56.268554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.268539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.270897 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.270872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 19 14:17:56.271044 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.271024    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 19 14:17:56.271225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.271208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 19 14:17:56.271294 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.271221    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 19 14:17:56.271347 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.271290    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8vwm\""
Jul 19 14:17:56.283728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.283701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"]
Jul 19 14:17:56.357511 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.357475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.357657 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.357525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.357657 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.357543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8jfr\" (UniqueName: \"kubernetes.io/projected/83f5fddf-048e-4d91-9837-4bf775eee3e6-kube-api-access-p8jfr\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.357657 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.357618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.357833 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.357654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8jfr\" (UniqueName: \"kubernetes.io/projected/83f5fddf-048e-4d91-9837-4bf775eee3e6-kube-api-access-p8jfr\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.458760 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.458734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.460593 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.460571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83f5fddf-048e-4d91-9837-4bf775eee3e6-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.460709 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.460690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.460779 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.460731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83f5fddf-048e-4d91-9837-4bf775eee3e6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.468534 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.468510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8jfr\" (UniqueName: \"kubernetes.io/projected/83f5fddf-048e-4d91-9837-4bf775eee3e6-kube-api-access-p8jfr\") pod \"opendatahub-operator-controller-manager-bd7c6769d-67dvm\" (UID: \"83f5fddf-048e-4d91-9837-4bf775eee3e6\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.578631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.578542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:17:56.712439 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:56.712400    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"]
Jul 19 14:17:56.716740 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:17:56.716715    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f5fddf_048e_4d91_9837_4bf775eee3e6.slice/crio-5367867a58cd8e82b7c698a68bd9d72d17f622791cf56e56623457335a6d7da0 WatchSource:0}: Error finding container 5367867a58cd8e82b7c698a68bd9d72d17f622791cf56e56623457335a6d7da0: Status 404 returned error can't find the container with id 5367867a58cd8e82b7c698a68bd9d72d17f622791cf56e56623457335a6d7da0
Jul 19 14:17:57.649511 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:57.649460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm" event={"ID":"83f5fddf-048e-4d91-9837-4bf775eee3e6","Type":"ContainerStarted","Data":"5367867a58cd8e82b7c698a68bd9d72d17f622791cf56e56623457335a6d7da0"}
Jul 19 14:17:59.660302 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:17:59.660268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm" event={"ID":"83f5fddf-048e-4d91-9837-4bf775eee3e6","Type":"ContainerStarted","Data":"b8ae4512f5f31d31105a9cd8de2c646f69cd8c4b93afbb36be08dda6983f763d"}
Jul 19 14:18:01.669170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:01.669139    2582 generic.go:356] "Generic (PLEG): container finished" podID="83f5fddf-048e-4d91-9837-4bf775eee3e6" containerID="b8ae4512f5f31d31105a9cd8de2c646f69cd8c4b93afbb36be08dda6983f763d" exitCode=0
Jul 19 14:18:01.669578 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:01.669216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm" event={"ID":"83f5fddf-048e-4d91-9837-4bf775eee3e6","Type":"ContainerDied","Data":"b8ae4512f5f31d31105a9cd8de2c646f69cd8c4b93afbb36be08dda6983f763d"}
Jul 19 14:18:02.675071 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:02.675043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm" event={"ID":"83f5fddf-048e-4d91-9837-4bf775eee3e6","Type":"ContainerStarted","Data":"b1619e1a93e4d8ce3292c39ac4e74848e53cea8adf5e430dd5cf5997cdba630a"}
Jul 19 14:18:02.675423 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:02.675265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:18:02.697866 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:02.697823    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm" podStartSLOduration=2.369096835 podStartE2EDuration="6.6978076s" totalImagesPullingTime="3.255053512s" totalInitContainerRuntime="1.073657253s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:02.695652981 +0000 UTC m=+315.979311448" watchObservedRunningTime="2026-07-19 14:18:02.6978076 +0000 UTC m=+315.981466045"
Jul 19 14:18:06.642384 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:06.642354    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d56c9879c-9lbgr"
Jul 19 14:18:13.682167 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:13.682132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-67dvm"
Jul 19 14:18:23.901922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.901881    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"]
Jul 19 14:18:23.906344 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.906323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.908494 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.908470    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 19 14:18:23.908494 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.908485    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fhzch\""
Jul 19 14:18:23.916175 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.916147    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"]
Jul 19 14:18:23.984638 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.984638 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.984850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.984850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.984850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.984850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv77x\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-kube-api-access-wv77x\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.985047 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.984967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.985101 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.985054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:23.985101 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:23.985088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.085943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.085907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.085943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.085948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.085976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv77x\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-kube-api-access-wv77x\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086577 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.086813 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086693    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.087002 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.086983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.088391 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.088364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.088620 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.088600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.104333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.104313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv77x\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-kube-api-access-wv77x\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.119244 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.119224    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f49125ba-51d5-48c3-9bec-ab7adaf7965d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678c69wc\" (UID: \"f49125ba-51d5-48c3-9bec-ab7adaf7965d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.217475 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.217385    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:24.355853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.355773    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"]
Jul 19 14:18:24.775422 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:24.775382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc" event={"ID":"f49125ba-51d5-48c3-9bec-ab7adaf7965d","Type":"ContainerStarted","Data":"fd802b666a3c59cdf7f0d9c789b0b5f25d1db5b88c193c18dc032ee9e27faa83"}
Jul 19 14:18:26.711440 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.711403    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"]
Jul 19 14:18:26.716181 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.716154    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.718881 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.718852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 19 14:18:26.719320 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.719292    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-r5jqp\""
Jul 19 14:18:26.728635 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.728609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"]
Jul 19 14:18:26.816757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.816712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-cert\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.816945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.816806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkdz9\" (UniqueName: \"kubernetes.io/projected/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-kube-api-access-fkdz9\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.918126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.918088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-cert\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.918347 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.918154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkdz9\" (UniqueName: \"kubernetes.io/projected/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-kube-api-access-fkdz9\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.920994 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.920968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-cert\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:26.927534 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:26.927506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkdz9\" (UniqueName: \"kubernetes.io/projected/0f60751a-fa7f-4eaf-9bf3-d063865ffe1d-kube-api-access-fkdz9\") pod \"kserve-controller-manager-d6f4b65b8-6jjxp\" (UID: \"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:27.029152 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.029109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:18:27.364130 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.364085    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:18:27.364220 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.364169    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:18:27.364220 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.364200    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:18:27.416697 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.416658    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"]
Jul 19 14:18:27.423980 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:18:27.423956    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f60751a_fa7f_4eaf_9bf3_d063865ffe1d.slice/crio-669577e49fad4fd7d7abcc3496f9ef776d94b518ea6bc75789f9f27b7827770e WatchSource:0}: Error finding container 669577e49fad4fd7d7abcc3496f9ef776d94b518ea6bc75789f9f27b7827770e: Status 404 returned error can't find the container with id 669577e49fad4fd7d7abcc3496f9ef776d94b518ea6bc75789f9f27b7827770e
Jul 19 14:18:27.792317 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.792267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc" event={"ID":"f49125ba-51d5-48c3-9bec-ab7adaf7965d","Type":"ContainerStarted","Data":"fa248bea5ff2b72ebfde437aad989539facbacbe761262cb1cc42a3f54148ad6"}
Jul 19 14:18:27.793605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:27.793583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp" event={"ID":"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d","Type":"ContainerStarted","Data":"669577e49fad4fd7d7abcc3496f9ef776d94b518ea6bc75789f9f27b7827770e"}
Jul 19 14:18:28.218319 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:28.218276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:28.224063 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:28.224035    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:28.242838 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:28.242788    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc" podStartSLOduration=2.243131452 podStartE2EDuration="5.242767967s" totalImagesPullingTime="2.999636515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:27.816765752 +0000 UTC m=+341.100424199" watchObservedRunningTime="2026-07-19 14:18:28.242767967 +0000 UTC m=+341.526426411"
Jul 19 14:18:28.799003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:28.798964    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:28.800225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:28.800197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678c69wc"
Jul 19 14:18:29.804911 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:29.804872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp" event={"ID":"0f60751a-fa7f-4eaf-9bf3-d063865ffe1d","Type":"ContainerStarted","Data":"f07b290dc8c3b8b4c666e3dccbdd8456083c4462e93c4de291cb45eb0c89356d"}
Jul 19 14:18:29.841650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:29.841555    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp" podStartSLOduration=1.6762621549999999 podStartE2EDuration="3.841537695s" totalImagesPullingTime="2.16527554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:29.840489503 +0000 UTC m=+343.124147950" watchObservedRunningTime="2026-07-19 14:18:29.841537695 +0000 UTC m=+343.125196140"
Jul 19 14:18:30.809308 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:18:30.809269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:19:01.818321 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:19:01.818245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6jjxp"
Jul 19 14:19:51.858923 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:19:51.858889    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:20:03.863977 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.863942    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"]
Jul 19 14:20:03.867288 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.867257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:03.869505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.869474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 19 14:20:03.869646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.869512    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xnh8n\""
Jul 19 14:20:03.869646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.869524    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 19 14:20:03.875755 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.875733    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"]
Jul 19 14:20:03.937338 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:03.937302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8jcn\" (UniqueName: \"kubernetes.io/projected/5ca425b5-ff11-4093-a5f2-177037b89294-kube-api-access-p8jcn\") pod \"authorino-operator-75cc8d5cb7-wr6kn\" (UID: \"5ca425b5-ff11-4093-a5f2-177037b89294\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:04.038291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:04.038255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8jcn\" (UniqueName: \"kubernetes.io/projected/5ca425b5-ff11-4093-a5f2-177037b89294-kube-api-access-p8jcn\") pod \"authorino-operator-75cc8d5cb7-wr6kn\" (UID: \"5ca425b5-ff11-4093-a5f2-177037b89294\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:04.049836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:04.049806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8jcn\" (UniqueName: \"kubernetes.io/projected/5ca425b5-ff11-4093-a5f2-177037b89294-kube-api-access-p8jcn\") pod \"authorino-operator-75cc8d5cb7-wr6kn\" (UID: \"5ca425b5-ff11-4093-a5f2-177037b89294\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:04.178367 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:04.178288    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:04.313401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:04.313378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"]
Jul 19 14:20:04.315700 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:20:04.315659    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca425b5_ff11_4093_a5f2_177037b89294.slice/crio-b35d50277e9bdfa1ef700aaa20c89fbe2b78b68f268abbcda122431d6752ae38 WatchSource:0}: Error finding container b35d50277e9bdfa1ef700aaa20c89fbe2b78b68f268abbcda122431d6752ae38: Status 404 returned error can't find the container with id b35d50277e9bdfa1ef700aaa20c89fbe2b78b68f268abbcda122431d6752ae38
Jul 19 14:20:05.232596 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:05.232553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn" event={"ID":"5ca425b5-ff11-4093-a5f2-177037b89294","Type":"ContainerStarted","Data":"b35d50277e9bdfa1ef700aaa20c89fbe2b78b68f268abbcda122431d6752ae38"}
Jul 19 14:20:07.247923 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:07.247888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn" event={"ID":"5ca425b5-ff11-4093-a5f2-177037b89294","Type":"ContainerStarted","Data":"218be59600849838c49376db009e4d833ed7c44914a64212001b08b1a8044737"}
Jul 19 14:20:07.248281 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:07.247943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:07.264071 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:07.264024    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn" podStartSLOduration=2.150964691 podStartE2EDuration="4.264010573s" totalImagesPullingTime="2.113045882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:07.262924054 +0000 UTC m=+440.546582516" watchObservedRunningTime="2026-07-19 14:20:07.264010573 +0000 UTC m=+440.547669020"
Jul 19 14:20:08.462399 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.462367    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"]
Jul 19 14:20:08.465933 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.465911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.468112 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.468090    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tx7vp\""
Jul 19 14:20:08.468257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.468146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 19 14:20:08.468400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.468382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 19 14:20:08.474369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.474339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"]
Jul 19 14:20:08.580373 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.580327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1c31309-2a93-427c-8268-f9beedc1d294-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.580564 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.580378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c31309-2a93-427c-8268-f9beedc1d294-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.580564 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.580439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm7g5\" (UniqueName: \"kubernetes.io/projected/c1c31309-2a93-427c-8268-f9beedc1d294-kube-api-access-mm7g5\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.681249 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.681213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1c31309-2a93-427c-8268-f9beedc1d294-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.681249 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.681255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c31309-2a93-427c-8268-f9beedc1d294-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.681471 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.681282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm7g5\" (UniqueName: \"kubernetes.io/projected/c1c31309-2a93-427c-8268-f9beedc1d294-kube-api-access-mm7g5\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.681932 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.681913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1c31309-2a93-427c-8268-f9beedc1d294-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.683641 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.683625    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1c31309-2a93-427c-8268-f9beedc1d294-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.692091 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.692067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm7g5\" (UniqueName: \"kubernetes.io/projected/c1c31309-2a93-427c-8268-f9beedc1d294-kube-api-access-mm7g5\") pod \"kuadrant-console-plugin-66b5774985-c4h2q\" (UID: \"c1c31309-2a93-427c-8268-f9beedc1d294\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.776146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.776060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"
Jul 19 14:20:08.910111 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:08.910080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q"]
Jul 19 14:20:08.913342 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:20:08.913310    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1c31309_2a93_427c_8268_f9beedc1d294.slice/crio-62adff5bab72cf5a11e5b0e44ca169c0a7bea2c0699afacd9d98a80b59e61877 WatchSource:0}: Error finding container 62adff5bab72cf5a11e5b0e44ca169c0a7bea2c0699afacd9d98a80b59e61877: Status 404 returned error can't find the container with id 62adff5bab72cf5a11e5b0e44ca169c0a7bea2c0699afacd9d98a80b59e61877
Jul 19 14:20:09.254244 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:09.254212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q" event={"ID":"c1c31309-2a93-427c-8268-f9beedc1d294","Type":"ContainerStarted","Data":"62adff5bab72cf5a11e5b0e44ca169c0a7bea2c0699afacd9d98a80b59e61877"}
Jul 19 14:20:16.883055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:16.883017    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f8c994d44-t9gzn" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console" containerID="cri-o://64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63" gracePeriod=15
Jul 19 14:20:18.206120 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:18.206079    2582 patch_prober.go:28] interesting pod/console-5f8c994d44-t9gzn container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body=
Jul 19 14:20:18.206559 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:18.206151    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5f8c994d44-t9gzn" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 19 14:20:18.252219 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:18.252152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wr6kn"
Jul 19 14:20:28.206221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:28.206168    2582 patch_prober.go:28] interesting pod/console-5f8c994d44-t9gzn container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body=
Jul 19 14:20:28.206682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:28.206254    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5f8c994d44-t9gzn" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused"
Jul 19 14:20:31.370877 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.370846    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:20:31.383776 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.383740    2582 generic.go:356] "Generic (PLEG): container finished" podID="6d52e0b3-cd99-4474-9872-490919098769" containerID="64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63" exitCode=0
Jul 19 14:20:31.383913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.383777    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c994d44-t9gzn" event={"ID":"6d52e0b3-cd99-4474-9872-490919098769","Type":"ContainerDied","Data":"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"}
Jul 19 14:20:31.383913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.383823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8c994d44-t9gzn" event={"ID":"6d52e0b3-cd99-4474-9872-490919098769","Type":"ContainerDied","Data":"26d2c7b46c601fe9e555f1a8c244af999e9dc7b1e11edd7bfaa1486402652410"}
Jul 19 14:20:31.383913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.383760    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8c994d44-t9gzn"
Jul 19 14:20:31.383913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.383850    2582 scope.go:117] "RemoveContainer" containerID="64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"
Jul 19 14:20:31.411792 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.411769    2582 scope.go:117] "RemoveContainer" containerID="64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"
Jul 19 14:20:31.412240 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:20:31.412210    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63\": container with ID starting with 64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63 not found: ID does not exist" containerID="64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"
Jul 19 14:20:31.412344 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.412246    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63"} err="failed to get container status \"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63\": rpc error: code = NotFound desc = could not find container \"64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63\": container with ID starting with 64d6fe2d677aadacd4cfb68af53552e30c7666622b0afbf613793604d7e9be63 not found: ID does not exist"
Jul 19 14:20:31.495899 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.495876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.495917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.495977    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496107 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496015    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496107 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbbp4\" (UniqueName: \"kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496203 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496111    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496203 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle\") pod \"6d52e0b3-cd99-4474-9872-490919098769\" (UID: \"6d52e0b3-cd99-4474-9872-490919098769\") "
Jul 19 14:20:31.496787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config" (OuterVolumeSpecName: "console-config") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:20:31.496787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:20:31.496787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496745    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:20:31.496787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.496754    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:20:31.498201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.498175    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:20:31.498283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.498205    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4" (OuterVolumeSpecName: "kube-api-access-lbbp4") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "kube-api-access-lbbp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:20:31.498331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.498294    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d52e0b3-cd99-4474-9872-490919098769" (UID: "6d52e0b3-cd99-4474-9872-490919098769"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:20:31.597366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597331    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-trusted-ca-bundle\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597363    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-console-config\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597372    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-serving-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597612 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597381    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d52e0b3-cd99-4474-9872-490919098769-console-oauth-config\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597612 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597390    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-oauth-serving-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597612 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597398    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbbp4\" (UniqueName: \"kubernetes.io/projected/6d52e0b3-cd99-4474-9872-490919098769-kube-api-access-lbbp4\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.597612 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.597407    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d52e0b3-cd99-4474-9872-490919098769-service-ca\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:20:31.708799 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.708731    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:20:31.712880 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:31.712855    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8c994d44-t9gzn"]
Jul 19 14:20:32.389853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:32.389811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q" event={"ID":"c1c31309-2a93-427c-8268-f9beedc1d294","Type":"ContainerStarted","Data":"4aa686a7989e53464fbf0516fcdefdd8c2ff761dc64d6ee4535b447d252b04d5"}
Jul 19 14:20:32.404486 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:32.404434    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-c4h2q" podStartSLOduration=1.870206385 podStartE2EDuration="24.404416998s" totalImagesPullingTime="22.534210613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:32.403587533 +0000 UTC m=+465.687245985" watchObservedRunningTime="2026-07-19 14:20:32.404416998 +0000 UTC m=+465.688075445"
Jul 19 14:20:33.246829 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:33.246792    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d52e0b3-cd99-4474-9872-490919098769" path="/var/lib/kubelet/pods/6d52e0b3-cd99-4474-9872-490919098769/volumes"
Jul 19 14:20:50.790973 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.790938    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"]
Jul 19 14:20:50.791459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.791313    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console"
Jul 19 14:20:50.791459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.791323    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console"
Jul 19 14:20:50.791459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.791378    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52e0b3-cd99-4474-9872-490919098769" containerName="console"
Jul 19 14:20:50.794495 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.794475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.796647 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.796624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vqgc2\""
Jul 19 14:20:50.806021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.805998    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"]
Jul 19 14:20:50.955728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.955957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.956128 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.955981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zws\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-kube-api-access-v7zws\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:50.956128 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:50.956010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zws\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-kube-api-access-v7zws\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057852 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057852 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.057960 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.057862    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.058141 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.058113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.058141 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.058131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.059456 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.059435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.059892 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.059873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.064925 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.064899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zws\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-kube-api-access-v7zws\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.065000 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.064944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c29b5a8-fd19-4dd8-8ed1-882cdae2249f-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-5njlh\" (UID: \"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.105100 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.105077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:51.234093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.234068    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"]
Jul 19 14:20:51.235738 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:20:51.235715    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c29b5a8_fd19_4dd8_8ed1_882cdae2249f.slice/crio-6b916549f713bba1071d64c950cbeddd857ebf2eed4da7a6fa7fd8f688e1d38d WatchSource:0}: Error finding container 6b916549f713bba1071d64c950cbeddd857ebf2eed4da7a6fa7fd8f688e1d38d: Status 404 returned error can't find the container with id 6b916549f713bba1071d64c950cbeddd857ebf2eed4da7a6fa7fd8f688e1d38d
Jul 19 14:20:51.237737 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.237702    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:20:51.237831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.237763    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:20:51.237831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.237792    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:20:51.479014 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.478975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" event={"ID":"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f","Type":"ContainerStarted","Data":"df74879cc74c014d66d5682b06134f89276dbc6d2e375ae0b7d100c788dcdc01"}
Jul 19 14:20:51.479323 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.479042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" event={"ID":"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f","Type":"ContainerStarted","Data":"6b916549f713bba1071d64c950cbeddd857ebf2eed4da7a6fa7fd8f688e1d38d"}
Jul 19 14:20:51.496983 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:51.496926    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" podStartSLOduration=1.4969072460000001 podStartE2EDuration="1.496907246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:51.495849672 +0000 UTC m=+484.779508117" watchObservedRunningTime="2026-07-19 14:20:51.496907246 +0000 UTC m=+484.780565694"
Jul 19 14:20:52.105534 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:52.105496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:52.110204 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:52.110180    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:52.483401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:52.483373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:20:52.484379 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:20:52.484338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:21:05.150091 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.150032    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:05.178850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.178803    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:05.179030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.178927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:05.181081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.181054    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xj4mh\""
Jul 19 14:21:05.365196 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.365163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbqb\" (UniqueName: \"kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb\") pod \"authorino-58cd955675-r7ksv\" (UID: \"40df7134-ebe0-47cb-aff7-fe1b2d5d0219\") " pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:05.466362 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.466293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbqb\" (UniqueName: \"kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb\") pod \"authorino-58cd955675-r7ksv\" (UID: \"40df7134-ebe0-47cb-aff7-fe1b2d5d0219\") " pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:05.473549 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.473525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbqb\" (UniqueName: \"kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb\") pod \"authorino-58cd955675-r7ksv\" (UID: \"40df7134-ebe0-47cb-aff7-fe1b2d5d0219\") " pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:05.488449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.488426    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:05.613712 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:05.613661    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:05.616167 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:21:05.616133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40df7134_ebe0_47cb_aff7_fe1b2d5d0219.slice/crio-37b538cd20fbd9bf775e7c3714f41362115d0bfd8a834c871d786c7b1c2240cf WatchSource:0}: Error finding container 37b538cd20fbd9bf775e7c3714f41362115d0bfd8a834c871d786c7b1c2240cf: Status 404 returned error can't find the container with id 37b538cd20fbd9bf775e7c3714f41362115d0bfd8a834c871d786c7b1c2240cf
Jul 19 14:21:06.555282 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:06.555216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r7ksv" event={"ID":"40df7134-ebe0-47cb-aff7-fe1b2d5d0219","Type":"ContainerStarted","Data":"37b538cd20fbd9bf775e7c3714f41362115d0bfd8a834c871d786c7b1c2240cf"}
Jul 19 14:21:09.573733 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:09.573698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r7ksv" event={"ID":"40df7134-ebe0-47cb-aff7-fe1b2d5d0219","Type":"ContainerStarted","Data":"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"}
Jul 19 14:21:09.588872 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:09.588827    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r7ksv" podStartSLOduration=1.5843752150000001 podStartE2EDuration="4.588813919s" totalImagesPullingTime="3.004438704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:21:09.586752883 +0000 UTC m=+502.870411331" watchObservedRunningTime="2026-07-19 14:21:09.588813919 +0000 UTC m=+502.872472360"
Jul 19 14:21:09.679306 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:09.679273    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:11.582496 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:11.582457    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r7ksv" podUID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" containerName="authorino" containerID="cri-o://a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2" gracePeriod=30
Jul 19 14:21:11.840436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:11.840369    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:11.921949 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:11.921921    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gbqb\" (UniqueName: \"kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb\") pod \"40df7134-ebe0-47cb-aff7-fe1b2d5d0219\" (UID: \"40df7134-ebe0-47cb-aff7-fe1b2d5d0219\") "
Jul 19 14:21:11.924088 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:11.924067    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb" (OuterVolumeSpecName: "kube-api-access-7gbqb") pod "40df7134-ebe0-47cb-aff7-fe1b2d5d0219" (UID: "40df7134-ebe0-47cb-aff7-fe1b2d5d0219"). InnerVolumeSpecName "kube-api-access-7gbqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:21:12.022757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.022717    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gbqb\" (UniqueName: \"kubernetes.io/projected/40df7134-ebe0-47cb-aff7-fe1b2d5d0219-kube-api-access-7gbqb\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:21:12.593624 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.593586    2582 generic.go:356] "Generic (PLEG): container finished" podID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" containerID="a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2" exitCode=0
Jul 19 14:21:12.594069 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.593637    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r7ksv"
Jul 19 14:21:12.594069 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.593643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r7ksv" event={"ID":"40df7134-ebe0-47cb-aff7-fe1b2d5d0219","Type":"ContainerDied","Data":"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"}
Jul 19 14:21:12.594069 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.593698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r7ksv" event={"ID":"40df7134-ebe0-47cb-aff7-fe1b2d5d0219","Type":"ContainerDied","Data":"37b538cd20fbd9bf775e7c3714f41362115d0bfd8a834c871d786c7b1c2240cf"}
Jul 19 14:21:12.594069 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.593721    2582 scope.go:117] "RemoveContainer" containerID="a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"
Jul 19 14:21:12.602509 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.602491    2582 scope.go:117] "RemoveContainer" containerID="a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"
Jul 19 14:21:12.602774 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:21:12.602753    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2\": container with ID starting with a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2 not found: ID does not exist" containerID="a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"
Jul 19 14:21:12.602832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.602782    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2"} err="failed to get container status \"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2\": rpc error: code = NotFound desc = could not find container \"a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2\": container with ID starting with a8e863c976f649e7113fe48bcccdf50dbedaf3ee5bc0ac72e60fc624b82700c2 not found: ID does not exist"
Jul 19 14:21:12.613507 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.613483    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:12.616450 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:12.616428    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r7ksv"]
Jul 19 14:21:13.246687 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:13.246647    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" path="/var/lib/kubelet/pods/40df7134-ebe0-47cb-aff7-fe1b2d5d0219/volumes"
Jul 19 14:21:37.580197 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.580160    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:37.580688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.580502    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" containerName="authorino"
Jul 19 14:21:37.580688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.580513    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" containerName="authorino"
Jul 19 14:21:37.580688 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.580577    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="40df7134-ebe0-47cb-aff7-fe1b2d5d0219" containerName="authorino"
Jul 19 14:21:37.584920 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.584899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:37.587305 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.587282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xj4mh\""
Jul 19 14:21:37.589890 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.589865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:37.649990 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.649952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpmb\" (UniqueName: \"kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb\") pod \"authorino-57c765996b-q5xw2\" (UID: \"29639981-4106-4428-9707-d53852f863ee\") " pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:37.751057 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.751019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpmb\" (UniqueName: \"kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb\") pod \"authorino-57c765996b-q5xw2\" (UID: \"29639981-4106-4428-9707-d53852f863ee\") " pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:37.759118 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.759093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpmb\" (UniqueName: \"kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb\") pod \"authorino-57c765996b-q5xw2\" (UID: \"29639981-4106-4428-9707-d53852f863ee\") " pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:37.849461 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.849380    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:37.849662 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.849650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:37.875189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.875160    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:21:37.878554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.878531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:37.880839 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.880820    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 19 14:21:37.885629 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.885605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:21:37.952339 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.952289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:37.952530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.952473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrdg\" (UniqueName: \"kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:37.980805 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:37.980767    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:38.053021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.052979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:38.053190 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.053068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrdg\" (UniqueName: \"kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:38.055572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.055547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:38.060007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.059983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrdg\" (UniqueName: \"kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg\") pod \"authorino-74bd46d558-5btwt\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") " pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:38.188857 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.188821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:21:38.320592 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.320566    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:21:38.322931 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:21:38.322904    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf11ea0d8_c823_4b92_a647_659d61ab65b5.slice/crio-4c8953eab78a62df81c6e9909d9e498778329ba586d2c81c1c9a223f6ca5edc1 WatchSource:0}: Error finding container 4c8953eab78a62df81c6e9909d9e498778329ba586d2c81c1c9a223f6ca5edc1: Status 404 returned error can't find the container with id 4c8953eab78a62df81c6e9909d9e498778329ba586d2c81c1c9a223f6ca5edc1
Jul 19 14:21:38.722513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.722482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c765996b-q5xw2" event={"ID":"29639981-4106-4428-9707-d53852f863ee","Type":"ContainerStarted","Data":"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"}
Jul 19 14:21:38.722942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.722529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c765996b-q5xw2" event={"ID":"29639981-4106-4428-9707-d53852f863ee","Type":"ContainerStarted","Data":"cef5f196af0b1f0ad22a8e913ed03cc439258765554fed72b2cb74eee2d6981e"}
Jul 19 14:21:38.722942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.722537    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57c765996b-q5xw2" podUID="29639981-4106-4428-9707-d53852f863ee" containerName="authorino" containerID="cri-o://8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3" gracePeriod=30
Jul 19 14:21:38.723728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.723705    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74bd46d558-5btwt" event={"ID":"f11ea0d8-c823-4b92-a647-659d61ab65b5","Type":"ContainerStarted","Data":"4c8953eab78a62df81c6e9909d9e498778329ba586d2c81c1c9a223f6ca5edc1"}
Jul 19 14:21:38.737413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.737362    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57c765996b-q5xw2" podStartSLOduration=1.367870334 podStartE2EDuration="1.737340668s" totalImagesPullingTime="369.470334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:21:38.735773689 +0000 UTC m=+532.019432137" watchObservedRunningTime="2026-07-19 14:21:38.737340668 +0000 UTC m=+532.020999116"
Jul 19 14:21:38.980033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:38.980008    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:39.060727 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.060651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjpmb\" (UniqueName: \"kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb\") pod \"29639981-4106-4428-9707-d53852f863ee\" (UID: \"29639981-4106-4428-9707-d53852f863ee\") "
Jul 19 14:21:39.062770 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.062747    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb" (OuterVolumeSpecName: "kube-api-access-fjpmb") pod "29639981-4106-4428-9707-d53852f863ee" (UID: "29639981-4106-4428-9707-d53852f863ee"). InnerVolumeSpecName "kube-api-access-fjpmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:21:39.161846 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.161808    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjpmb\" (UniqueName: \"kubernetes.io/projected/29639981-4106-4428-9707-d53852f863ee-kube-api-access-fjpmb\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:21:39.729900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.729864    2582 generic.go:356] "Generic (PLEG): container finished" podID="29639981-4106-4428-9707-d53852f863ee" containerID="8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3" exitCode=0
Jul 19 14:21:39.730373 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.729906    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c765996b-q5xw2"
Jul 19 14:21:39.730373 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.729948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c765996b-q5xw2" event={"ID":"29639981-4106-4428-9707-d53852f863ee","Type":"ContainerDied","Data":"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"}
Jul 19 14:21:39.730373 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.729984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c765996b-q5xw2" event={"ID":"29639981-4106-4428-9707-d53852f863ee","Type":"ContainerDied","Data":"cef5f196af0b1f0ad22a8e913ed03cc439258765554fed72b2cb74eee2d6981e"}
Jul 19 14:21:39.730373 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.730006    2582 scope.go:117] "RemoveContainer" containerID="8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"
Jul 19 14:21:39.731686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.731643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74bd46d558-5btwt" event={"ID":"f11ea0d8-c823-4b92-a647-659d61ab65b5","Type":"ContainerStarted","Data":"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"}
Jul 19 14:21:39.738644 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.738626    2582 scope.go:117] "RemoveContainer" containerID="8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"
Jul 19 14:21:39.738917 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:21:39.738896    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3\": container with ID starting with 8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3 not found: ID does not exist" containerID="8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"
Jul 19 14:21:39.738983 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.738928    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3"} err="failed to get container status \"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3\": rpc error: code = NotFound desc = could not find container \"8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3\": container with ID starting with 8cdac2f7b05b408115524c75842f04f54b1e89df3210c7ad522c7b26dccd91d3 not found: ID does not exist"
Jul 19 14:21:39.744330 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.744294    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:39.747605 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.747583    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57c765996b-q5xw2"]
Jul 19 14:21:39.759717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:39.759659    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74bd46d558-5btwt" podStartSLOduration=2.38184205 podStartE2EDuration="2.759646786s" totalImagesPullingTime="377.804736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:21:39.758525908 +0000 UTC m=+533.042184349" watchObservedRunningTime="2026-07-19 14:21:39.759646786 +0000 UTC m=+533.043305232"
Jul 19 14:21:41.247806 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:21:41.247769    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29639981-4106-4428-9707-d53852f863ee" path="/var/lib/kubelet/pods/29639981-4106-4428-9707-d53852f863ee/volumes"
Jul 19 14:22:26.947115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.947031    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c29b5a8-fd19-4dd8-8ed1-882cdae2249f" containerID="df74879cc74c014d66d5682b06134f89276dbc6d2e375ae0b7d100c788dcdc01" exitCode=0
Jul 19 14:22:26.947115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.947105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" event={"ID":"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f","Type":"ContainerDied","Data":"df74879cc74c014d66d5682b06134f89276dbc6d2e375ae0b7d100c788dcdc01"}
Jul 19 14:22:26.947531 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.947477    2582 scope.go:117] "RemoveContainer" containerID="df74879cc74c014d66d5682b06134f89276dbc6d2e375ae0b7d100c788dcdc01"
Jul 19 14:22:26.948493 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.948467    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:22:26.948554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.948532    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:22:26.948589 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:26.948563    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:22:27.956303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:27.956265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" event={"ID":"3c29b5a8-fd19-4dd8-8ed1-882cdae2249f","Type":"ContainerStarted","Data":"6d6d74caccbe69d7f430abad188b274f80f611ef39c11d8c89ea9fd85695c059"}
Jul 19 14:22:28.105457 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:28.105424    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:22:28.105689 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:28.105639    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5njlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 19 14:22:28.105771 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:28.105722    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" podUID="3c29b5a8-fd19-4dd8-8ed1-882cdae2249f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 19 14:22:29.105842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:29.105805    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5njlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 19 14:22:29.106208 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:29.105864    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" podUID="3c29b5a8-fd19-4dd8-8ed1-882cdae2249f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 19 14:22:30.105661 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:30.105625    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5njlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 19 14:22:30.105876 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:30.105733    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" podUID="3c29b5a8-fd19-4dd8-8ed1-882cdae2249f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 19 14:22:31.106461 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:31.106422    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-5njlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Jul 19 14:22:31.106889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:31.106490    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh" podUID="3c29b5a8-fd19-4dd8-8ed1-882cdae2249f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Jul 19 14:22:32.108865 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:32.108834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:22:32.109260 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:32.109083    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:22:32.109717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:32.109703    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-5njlh"
Jul 19 14:22:47.183707 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.183679    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:22:47.184174 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.184154    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:22:47.291227 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.291186    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"]
Jul 19 14:22:47.291771 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.291747    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29639981-4106-4428-9707-d53852f863ee" containerName="authorino"
Jul 19 14:22:47.292004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.291986    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29639981-4106-4428-9707-d53852f863ee" containerName="authorino"
Jul 19 14:22:47.292250 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.292235    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29639981-4106-4428-9707-d53852f863ee" containerName="authorino"
Jul 19 14:22:47.294771 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.294750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.297594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.297570    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 19 14:22:47.297716 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.297645    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 19 14:22:47.297716 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.297652    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vrhz7\""
Jul 19 14:22:47.297831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.297653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 19 14:22:47.304433 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.304408    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"]
Jul 19 14:22:47.354501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.354685 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.354685 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.354763 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.354763 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0041f2d2-c912-4649-9188-5a6f11da4182-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.354840 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.354761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4nm\" (UniqueName: \"kubernetes.io/projected/0041f2d2-c912-4649-9188-5a6f11da4182-kube-api-access-2w4nm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455551 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455551 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0041f2d2-c912-4649-9188-5a6f11da4182-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455551 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4nm\" (UniqueName: \"kubernetes.io/projected/0041f2d2-c912-4649-9188-5a6f11da4182-kube-api-access-2w4nm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455551 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.455992 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.455967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.456054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.456000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.456054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.456021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.457940 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.457922    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0041f2d2-c912-4649-9188-5a6f11da4182-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.458144 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.458127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0041f2d2-c912-4649-9188-5a6f11da4182-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.463257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.463236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4nm\" (UniqueName: \"kubernetes.io/projected/0041f2d2-c912-4649-9188-5a6f11da4182-kube-api-access-2w4nm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dhc8q\" (UID: \"0041f2d2-c912-4649-9188-5a6f11da4182\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.608449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.608405    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:47.740971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:47.740946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"]
Jul 19 14:22:47.743646 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:22:47.743615    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0041f2d2_c912_4649_9188_5a6f11da4182.slice/crio-137ece98aa6e35eba740e0168335e4dff88abb0384770232a0f3b14e80d6702e WatchSource:0}: Error finding container 137ece98aa6e35eba740e0168335e4dff88abb0384770232a0f3b14e80d6702e: Status 404 returned error can't find the container with id 137ece98aa6e35eba740e0168335e4dff88abb0384770232a0f3b14e80d6702e
Jul 19 14:22:48.050167 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:48.050025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q" event={"ID":"0041f2d2-c912-4649-9188-5a6f11da4182","Type":"ContainerStarted","Data":"137ece98aa6e35eba740e0168335e4dff88abb0384770232a0f3b14e80d6702e"}
Jul 19 14:22:49.057230 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:49.057192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q" event={"ID":"0041f2d2-c912-4649-9188-5a6f11da4182","Type":"ContainerStarted","Data":"6006571e99a14852a45c634c1cbdabd1a436e19841feb632f08e96a60159156d"}
Jul 19 14:22:49.073083 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:49.073032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q" podStartSLOduration=0.987834081 podStartE2EDuration="2.073015634s" totalImagesPullingTime="1.085181553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:22:49.071607773 +0000 UTC m=+602.355266216" watchObservedRunningTime="2026-07-19 14:22:49.073015634 +0000 UTC m=+602.356674081"
Jul 19 14:22:57.609168 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:57.609130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:57.609744 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:57.609193    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:57.621453 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:57.621428    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:22:58.109472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:22:58.109446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dhc8q"
Jul 19 14:23:04.895102 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:04.895065    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"]
Jul 19 14:23:04.898881 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:04.898859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:04.900977 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:04.900951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 19 14:23:04.908372 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:04.908347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"]
Jul 19 14:23:05.017056 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.017241 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.017241 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6044ce64-ae0f-4aad-99a3-137922885a3a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.017241 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cm5p\" (UniqueName: \"kubernetes.io/projected/6044ce64-ae0f-4aad-99a3-137922885a3a-kube-api-access-5cm5p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.017376 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.017424 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.017387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118270 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6044ce64-ae0f-4aad-99a3-137922885a3a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cm5p\" (UniqueName: \"kubernetes.io/projected/6044ce64-ae0f-4aad-99a3-137922885a3a-kube-api-access-5cm5p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118569 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118622 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118847 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.118940 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.118921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.120805 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.120782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6044ce64-ae0f-4aad-99a3-137922885a3a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.121007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.120993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6044ce64-ae0f-4aad-99a3-137922885a3a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.125286 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.125264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cm5p\" (UniqueName: \"kubernetes.io/projected/6044ce64-ae0f-4aad-99a3-137922885a3a-kube-api-access-5cm5p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rhbl4\" (UID: \"6044ce64-ae0f-4aad-99a3-137922885a3a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.209961 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.209862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:05.343947 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.343921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"]
Jul 19 14:23:05.346141 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:23:05.346114    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6044ce64_ae0f_4aad_99a3_137922885a3a.slice/crio-a900f1156dfa85d9ead0c731da7e3079c7549d6e56b72db4d52fac6c2458dbc8 WatchSource:0}: Error finding container a900f1156dfa85d9ead0c731da7e3079c7549d6e56b72db4d52fac6c2458dbc8: Status 404 returned error can't find the container with id a900f1156dfa85d9ead0c731da7e3079c7549d6e56b72db4d52fac6c2458dbc8
Jul 19 14:23:05.347511 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:05.347493    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:23:06.143802 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:06.143765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4" event={"ID":"6044ce64-ae0f-4aad-99a3-137922885a3a","Type":"ContainerStarted","Data":"df856af5dd4abd074b8b42c6144a75e1974961b05c5f26977e54a3b8f162cb92"}
Jul 19 14:23:06.144251 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:06.143815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4" event={"ID":"6044ce64-ae0f-4aad-99a3-137922885a3a","Type":"ContainerStarted","Data":"a900f1156dfa85d9ead0c731da7e3079c7549d6e56b72db4d52fac6c2458dbc8"}
Jul 19 14:23:06.160163 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:06.160112    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4" podStartSLOduration=1.978662913 podStartE2EDuration="2.160096048s" totalImagesPullingTime="181.433135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:23:06.159228945 +0000 UTC m=+619.442887400" watchObservedRunningTime="2026-07-19 14:23:06.160096048 +0000 UTC m=+619.443754494"
Jul 19 14:23:15.210929 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:15.210849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:15.210929 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:15.210924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:15.223395 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:15.223370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:23:16.200211 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:23:16.200181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rhbl4"
Jul 19 14:24:16.989965 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:16.989923    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79f785b9cf-b9j5d"]
Jul 19 14:24:16.993116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:16.993092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.000604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.000305    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79f785b9cf-b9j5d"]
Jul 19 14:24:17.039045 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.039011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ff2f89f-a21d-49b7-86da-68eab53fd68d-tls-cert\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.039219 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.039086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snc8q\" (UniqueName: \"kubernetes.io/projected/7ff2f89f-a21d-49b7-86da-68eab53fd68d-kube-api-access-snc8q\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.140397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.140358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snc8q\" (UniqueName: \"kubernetes.io/projected/7ff2f89f-a21d-49b7-86da-68eab53fd68d-kube-api-access-snc8q\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.140569 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.140433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ff2f89f-a21d-49b7-86da-68eab53fd68d-tls-cert\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.142875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.142854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ff2f89f-a21d-49b7-86da-68eab53fd68d-tls-cert\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.147558 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.147527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snc8q\" (UniqueName: \"kubernetes.io/projected/7ff2f89f-a21d-49b7-86da-68eab53fd68d-kube-api-access-snc8q\") pod \"authorino-79f785b9cf-b9j5d\" (UID: \"7ff2f89f-a21d-49b7-86da-68eab53fd68d\") " pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.303129 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.303044    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79f785b9cf-b9j5d"
Jul 19 14:24:17.443884 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.443861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79f785b9cf-b9j5d"]
Jul 19 14:24:17.446307 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:24:17.446283    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ff2f89f_a21d_49b7_86da_68eab53fd68d.slice/crio-d755b25e230be5103d44f8d357e27b57850f1f40622d77239f60b9e14363e7e7 WatchSource:0}: Error finding container d755b25e230be5103d44f8d357e27b57850f1f40622d77239f60b9e14363e7e7: Status 404 returned error can't find the container with id d755b25e230be5103d44f8d357e27b57850f1f40622d77239f60b9e14363e7e7
Jul 19 14:24:17.486835 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:17.486796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79f785b9cf-b9j5d" event={"ID":"7ff2f89f-a21d-49b7-86da-68eab53fd68d","Type":"ContainerStarted","Data":"d755b25e230be5103d44f8d357e27b57850f1f40622d77239f60b9e14363e7e7"}
Jul 19 14:24:18.495481 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.495433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79f785b9cf-b9j5d" event={"ID":"7ff2f89f-a21d-49b7-86da-68eab53fd68d","Type":"ContainerStarted","Data":"7aea6b33e06596faa1b3b0c788cdb8ec57564fd067c213df7482d17b10334025"}
Jul 19 14:24:18.520089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.520002    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79f785b9cf-b9j5d" podStartSLOduration=1.9647019430000001 podStartE2EDuration="2.519983962s" totalImagesPullingTime="555.282019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:24:18.518959609 +0000 UTC m=+691.802618055" watchObservedRunningTime="2026-07-19 14:24:18.519983962 +0000 UTC m=+691.803642404"
Jul 19 14:24:18.567690 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.567638    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:24:18.568002 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.567969    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-74bd46d558-5btwt" podUID="f11ea0d8-c823-4b92-a647-659d61ab65b5" containerName="authorino" containerID="cri-o://942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f" gracePeriod=30
Jul 19 14:24:18.833997 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.833965    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:24:18.854948 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.854908    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert\") pod \"f11ea0d8-c823-4b92-a647-659d61ab65b5\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") "
Jul 19 14:24:18.855136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.855006    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrdg\" (UniqueName: \"kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg\") pod \"f11ea0d8-c823-4b92-a647-659d61ab65b5\" (UID: \"f11ea0d8-c823-4b92-a647-659d61ab65b5\") "
Jul 19 14:24:18.858052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.858011    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg" (OuterVolumeSpecName: "kube-api-access-5wrdg") pod "f11ea0d8-c823-4b92-a647-659d61ab65b5" (UID: "f11ea0d8-c823-4b92-a647-659d61ab65b5"). InnerVolumeSpecName "kube-api-access-5wrdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:24:18.867655 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.867610    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f11ea0d8-c823-4b92-a647-659d61ab65b5" (UID: "f11ea0d8-c823-4b92-a647-659d61ab65b5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:24:18.956284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.956246    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f11ea0d8-c823-4b92-a647-659d61ab65b5-tls-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:24:18.956284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:18.956275    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrdg\" (UniqueName: \"kubernetes.io/projected/f11ea0d8-c823-4b92-a647-659d61ab65b5-kube-api-access-5wrdg\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:24:19.501705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.501606    2582 generic.go:356] "Generic (PLEG): container finished" podID="f11ea0d8-c823-4b92-a647-659d61ab65b5" containerID="942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f" exitCode=0
Jul 19 14:24:19.501705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.501650    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74bd46d558-5btwt"
Jul 19 14:24:19.502163 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.501699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74bd46d558-5btwt" event={"ID":"f11ea0d8-c823-4b92-a647-659d61ab65b5","Type":"ContainerDied","Data":"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"}
Jul 19 14:24:19.502163 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.501750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74bd46d558-5btwt" event={"ID":"f11ea0d8-c823-4b92-a647-659d61ab65b5","Type":"ContainerDied","Data":"4c8953eab78a62df81c6e9909d9e498778329ba586d2c81c1c9a223f6ca5edc1"}
Jul 19 14:24:19.502163 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.501771    2582 scope.go:117] "RemoveContainer" containerID="942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"
Jul 19 14:24:19.512155 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.512136    2582 scope.go:117] "RemoveContainer" containerID="942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"
Jul 19 14:24:19.512443 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:24:19.512425    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f\": container with ID starting with 942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f not found: ID does not exist" containerID="942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"
Jul 19 14:24:19.512497 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.512452    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f"} err="failed to get container status \"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f\": rpc error: code = NotFound desc = could not find container \"942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f\": container with ID starting with 942ccc1b11f684fb726915d37e0cc8995e687270f64812331080c67c42ffe15f not found: ID does not exist"
Jul 19 14:24:19.516068 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.516041    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:24:19.518286 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:19.518261    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74bd46d558-5btwt"]
Jul 19 14:24:21.250862 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:24:21.250199    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f11ea0d8-c823-4b92-a647-659d61ab65b5" path="/var/lib/kubelet/pods/f11ea0d8-c823-4b92-a647-659d61ab65b5/volumes"
Jul 19 14:27:47.211406 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:27:47.211323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:27:47.213841 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:27:47.213814    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:32:47.240166 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:32:47.240138    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:32:47.251596 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:32:47.251567    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:34:48.083633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.083601    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:34:48.084086 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.083973    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f11ea0d8-c823-4b92-a647-659d61ab65b5" containerName="authorino"
Jul 19 14:34:48.084086 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.083988    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f11ea0d8-c823-4b92-a647-659d61ab65b5" containerName="authorino"
Jul 19 14:34:48.084086 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.084050    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f11ea0d8-c823-4b92-a647-659d61ab65b5" containerName="authorino"
Jul 19 14:34:48.086887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.086863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.088928 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.088905    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8f2dd3d7-kserve-self-signed-certs\""
Jul 19 14:34:48.096751 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.096730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:34:48.174125 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.174238 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqsw\" (UniqueName: \"kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.174238 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.174359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.174359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.174359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.174340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274661 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqsw\" (UniqueName: \"kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274849 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274964 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.274964 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.274958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.275077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.275054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.275264 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.275243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.275331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.275313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.277111 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.277092    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.277263 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.277246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.281677 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.281643    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqsw\" (UniqueName: \"kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw\") pod \"e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") " pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.397105 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.397076    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:48.524879 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.524853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:34:48.527030 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:34:48.527006    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfba9ea1_9b1b_4818_b087_41d47b7b1094.slice/crio-2bfef005cd1e990ee17e6b537466754e3afd45a201cc6d4dd6254517dd2bd48d WatchSource:0}: Error finding container 2bfef005cd1e990ee17e6b537466754e3afd45a201cc6d4dd6254517dd2bd48d: Status 404 returned error can't find the container with id 2bfef005cd1e990ee17e6b537466754e3afd45a201cc6d4dd6254517dd2bd48d
Jul 19 14:34:48.559188 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:48.559164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" event={"ID":"cfba9ea1-9b1b-4818-b087-41d47b7b1094","Type":"ContainerStarted","Data":"2bfef005cd1e990ee17e6b537466754e3afd45a201cc6d4dd6254517dd2bd48d"}
Jul 19 14:34:49.565193 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:49.565111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" event={"ID":"cfba9ea1-9b1b-4818-b087-41d47b7b1094","Type":"ContainerStarted","Data":"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"}
Jul 19 14:34:49.581450 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:49.581405    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" podStartSLOduration=1.5813919749999998 podStartE2EDuration="1.581391975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:34:49.57996182 +0000 UTC m=+1322.863620266" watchObservedRunningTime="2026-07-19 14:34:49.581391975 +0000 UTC m=+1322.865050420"
Jul 19 14:34:58.397349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:58.397312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:58.397823 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:58.397364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:58.409511 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:58.409488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:34:58.619422 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:34:58.619390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:35:21.378762 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:21.378686    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:35:36.398098 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.398049    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" podUID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" containerName="main" containerID="cri-o://e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2" gracePeriod=45
Jul 19 14:35:36.644129 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.644108    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:35:36.661117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661060    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbqsw\" (UniqueName: \"kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661236 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661147    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661236 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661236 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661264    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661427    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:36.661459 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661440    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home" (OuterVolumeSpecName: "home") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:36.661683 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache\") pod \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\" (UID: \"cfba9ea1-9b1b-4818-b087-41d47b7b1094\") "
Jul 19 14:35:36.661946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.661923    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache" (OuterVolumeSpecName: "model-cache") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:36.662271 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.662251    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tmp-dir\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.662379 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.662366    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-home\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.662468 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.662449    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-model-cache\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.663543 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.663517    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:35:36.663832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.663809    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw" (OuterVolumeSpecName: "kube-api-access-vbqsw") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "kube-api-access-vbqsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:35:36.663832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.663813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm" (OuterVolumeSpecName: "dshm") pod "cfba9ea1-9b1b-4818-b087-41d47b7b1094" (UID: "cfba9ea1-9b1b-4818-b087-41d47b7b1094"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:36.763285 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.763262    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbqsw\" (UniqueName: \"kubernetes.io/projected/cfba9ea1-9b1b-4818-b087-41d47b7b1094-kube-api-access-vbqsw\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.763285 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.763283    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfba9ea1-9b1b-4818-b087-41d47b7b1094-tls-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.763394 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.763292    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfba9ea1-9b1b-4818-b087-41d47b7b1094-dshm\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.781547 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.781520    2582 generic.go:356] "Generic (PLEG): container finished" podID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" containerID="e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2" exitCode=0
Jul 19 14:35:36.781626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.781560    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"
Jul 19 14:35:36.781626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.781567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" event={"ID":"cfba9ea1-9b1b-4818-b087-41d47b7b1094","Type":"ContainerDied","Data":"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"}
Jul 19 14:35:36.781626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.781603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r" event={"ID":"cfba9ea1-9b1b-4818-b087-41d47b7b1094","Type":"ContainerDied","Data":"2bfef005cd1e990ee17e6b537466754e3afd45a201cc6d4dd6254517dd2bd48d"}
Jul 19 14:35:36.781626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.781624    2582 scope.go:117] "RemoveContainer" containerID="e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"
Jul 19 14:35:36.792369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.792353    2582 scope.go:117] "RemoveContainer" containerID="e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"
Jul 19 14:35:36.792589 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:35:36.792574    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2\": container with ID starting with e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2 not found: ID does not exist" containerID="e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"
Jul 19 14:35:36.792632 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.792595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2"} err="failed to get container status \"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2\": rpc error: code = NotFound desc = could not find container \"e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2\": container with ID starting with e0373eff898820561e3bf2a3d6bfa646eaf58441263f0ff484f6a5831fd880c2 not found: ID does not exist"
Jul 19 14:35:36.801988 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.801969    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:35:36.805877 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:36.805857    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8f2dd3d7-kserve-6c75d68699-4wx7r"]
Jul 19 14:35:37.248680 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:35:37.248650    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" path="/var/lib/kubelet/pods/cfba9ea1-9b1b-4818-b087-41d47b7b1094/volumes"
Jul 19 14:37:47.273182 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:37:47.273072    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:37:47.280053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:37:47.280035    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:38:37.584465 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.584396    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:38:37.584905 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.584749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" containerName="main"
Jul 19 14:38:37.584905 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.584762    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" containerName="main"
Jul 19 14:38:37.584905 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.584829    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfba9ea1-9b1b-4818-b087-41d47b7b1094" containerName="main"
Jul 19 14:38:37.587720 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.587652    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.589943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.589923    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2e6251c8-openshift-default-dockercfg-9w6hx\""
Jul 19 14:38:37.607062 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.607039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:38:37.633443 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633561 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8xrz\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633610 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633649 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.633874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.633823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.734965 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.734934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.734965 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.734966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.734995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735205 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8xrz\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735276 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735326 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735378 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735378 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735479 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735617 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735596    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735756 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735797 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735751    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.735797 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.735740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.737221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.737203    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.737831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.737815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.742424 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.742407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.742590 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.742574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8xrz\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz\") pod \"e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") " pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:37.897741 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:37.897719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:38.033703 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.033659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:38:38.035363 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:38:38.035337    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa48566_ff35_464a_b69e_25ebb0e1df79.slice/crio-89efe10fc78c63d8f936200359873f9b41e0696198de3a8b19dcbdd045fdd112 WatchSource:0}: Error finding container 89efe10fc78c63d8f936200359873f9b41e0696198de3a8b19dcbdd045fdd112: Status 404 returned error can't find the container with id 89efe10fc78c63d8f936200359873f9b41e0696198de3a8b19dcbdd045fdd112
Jul 19 14:38:38.037499 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.037470    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:38.037575 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.037532    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:38.037575 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.037560    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:38.632015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.631983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerStarted","Data":"391dca3e9be39668f93f94db0ba3e67f53089c7a170aacb5a50329cacba27db1"}
Jul 19 14:38:38.632396 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.632047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerStarted","Data":"89efe10fc78c63d8f936200359873f9b41e0696198de3a8b19dcbdd045fdd112"}
Jul 19 14:38:38.652362 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.652309    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podStartSLOduration=1.652294646 podStartE2EDuration="1.652294646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:38:38.650755036 +0000 UTC m=+1551.934413482" watchObservedRunningTime="2026-07-19 14:38:38.652294646 +0000 UTC m=+1551.935953091"
Jul 19 14:38:38.897976 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:38.897910    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:39.902487 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:39.902460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:40.640904 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:40.640877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:40.641748 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:40.641729    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:55.642429 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.642396    2582 patch_prober.go:28] interesting pod/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 19 14:38:55.642816 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.642466    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 19 14:38:55.708813 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.708785    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerID="391dca3e9be39668f93f94db0ba3e67f53089c7a170aacb5a50329cacba27db1" exitCode=0
Jul 19 14:38:55.708931 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.708847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerDied","Data":"391dca3e9be39668f93f94db0ba3e67f53089c7a170aacb5a50329cacba27db1"}
Jul 19 14:38:55.709140 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.709126    2582 scope.go:117] "RemoveContainer" containerID="391dca3e9be39668f93f94db0ba3e67f53089c7a170aacb5a50329cacba27db1"
Jul 19 14:38:55.710000 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.709978    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:55.710055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.710038    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:55.710096 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:55.710068    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:38:56.715544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:56.715511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerStarted","Data":"f9c1b8b78d17aaa8bf0ed83d80769ebb946ee537318718faf1bdfe1d25e41ed0"}
Jul 19 14:38:56.898119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:56.898081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:38:56.898342 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:56.898298    2582 patch_prober.go:28] interesting pod/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 19 14:38:56.898413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:56.898363    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 19 14:38:57.898913 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:57.898880    2582 patch_prober.go:28] interesting pod/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 19 14:38:57.899275 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:57.898932    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 19 14:38:58.898932 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:58.898900    2582 patch_prober.go:28] interesting pod/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 19 14:38:58.899299 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:58.898976    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 19 14:38:59.898938 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:59.898904    2582 patch_prober.go:28] interesting pod/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 19 14:38:59.899284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:38:59.898957    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 19 14:39:00.901721 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:00.901693    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:39:00.902077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:00.901919    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:39:00.902579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:00.902562    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:39:20.739885 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:20.739853    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:39:20.740411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:20.740096    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy" containerID="cri-o://f9c1b8b78d17aaa8bf0ed83d80769ebb946ee537318718faf1bdfe1d25e41ed0" gracePeriod=30
Jul 19 14:39:21.757022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.756988    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:39:21.760274 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.760259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.762480 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.762453    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c6a7edc8-gw-openshift-default-dockercfg-mmbl7\""
Jul 19 14:39:21.774924 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.774902    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:39:21.891095 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891095 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891300 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891300 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891300 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdprv\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891300 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891492 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891492 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.891492 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.891363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992537 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdprv\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992537 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992537 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992537 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992537 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992965 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.992965 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.993065 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.992981    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.993065 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.993058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.993318 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.993299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.994935 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.994907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.995121 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.995104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.999449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.999428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:21.999632 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:21.999612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdprv\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv\") pod \"e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") " pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:22.070271 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.070219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:22.201413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.201372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:39:22.204119 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:39:22.204095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba2afd8_3f0d_4773_bc1b_5939ec969a9a.slice/crio-d8baf5715b87a4f3cbbce50d8f94e79a7332775b5550f0512cf616e121125af8 WatchSource:0}: Error finding container d8baf5715b87a4f3cbbce50d8f94e79a7332775b5550f0512cf616e121125af8: Status 404 returned error can't find the container with id d8baf5715b87a4f3cbbce50d8f94e79a7332775b5550f0512cf616e121125af8
Jul 19 14:39:22.206093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.206060    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:22.206165 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.206125    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:22.206165 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.206153    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:22.848101 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.848067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerStarted","Data":"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"}
Jul 19 14:39:22.848452 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.848120    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerStarted","Data":"d8baf5715b87a4f3cbbce50d8f94e79a7332775b5550f0512cf616e121125af8"}
Jul 19 14:39:22.865757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:22.865716    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podStartSLOduration=1.865701571 podStartE2EDuration="1.865701571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:39:22.864939202 +0000 UTC m=+1596.148597658" watchObservedRunningTime="2026-07-19 14:39:22.865701571 +0000 UTC m=+1596.149360017"
Jul 19 14:39:23.070813 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:23.070787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:23.075273 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:23.075250    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:23.852282 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:23.852252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:23.853151 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:23.853128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:25.871159 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:25.871131    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerID="f9c1b8b78d17aaa8bf0ed83d80769ebb946ee537318718faf1bdfe1d25e41ed0" exitCode=0
Jul 19 14:39:25.871482 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:25.871202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerDied","Data":"f9c1b8b78d17aaa8bf0ed83d80769ebb946ee537318718faf1bdfe1d25e41ed0"}
Jul 19 14:39:25.871482 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:25.871285    2582 scope.go:117] "RemoveContainer" containerID="391dca3e9be39668f93f94db0ba3e67f53089c7a170aacb5a50329cacba27db1"
Jul 19 14:39:25.992070 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:25.992047    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:39:26.126420 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126420 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126463    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126540    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126571    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126589    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8xrz\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert\") pod \"1fa48566-ff35-464a-b69e-25ebb0e1df79\" (UID: \"1fa48566-ff35-464a-b69e-25ebb0e1df79\") "
Jul 19 14:39:26.126910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:39:26.126910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:39:26.126910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126835    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:39:26.127126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126930    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.127126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.126947    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.127126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.127001    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:39:26.127509 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.127488    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:39:26.128836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.128812    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:39:26.128955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.128834    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:39:26.128955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.128937    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:39:26.128955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.128936    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz" (OuterVolumeSpecName: "kube-api-access-j8xrz") pod "1fa48566-ff35-464a-b69e-25ebb0e1df79" (UID: "1fa48566-ff35-464a-b69e-25ebb0e1df79"). InnerVolumeSpecName "kube-api-access-j8xrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:39:26.228262 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228241    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228262 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228260    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228269    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228278    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fa48566-ff35-464a-b69e-25ebb0e1df79-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228286    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8xrz\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-kube-api-access-j8xrz\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228293    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fa48566-ff35-464a-b69e-25ebb0e1df79-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.228387 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.228302    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa48566-ff35-464a-b69e-25ebb0e1df79-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:39:26.876950 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.876933    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"
Jul 19 14:39:26.877325 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.876979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl" event={"ID":"1fa48566-ff35-464a-b69e-25ebb0e1df79","Type":"ContainerDied","Data":"89efe10fc78c63d8f936200359873f9b41e0696198de3a8b19dcbdd045fdd112"}
Jul 19 14:39:26.877325 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.877032    2582 scope.go:117] "RemoveContainer" containerID="f9c1b8b78d17aaa8bf0ed83d80769ebb946ee537318718faf1bdfe1d25e41ed0"
Jul 19 14:39:26.897501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.897480    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:39:26.900749 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:26.900730    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2e6251c8-openshift-default-59cc85f59f-hvgrl"]
Jul 19 14:39:27.247034 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:27.247011    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" path="/var/lib/kubelet/pods/1fa48566-ff35-464a-b69e-25ebb0e1df79/volumes"
Jul 19 14:39:37.930296 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.930265    2582 generic.go:356] "Generic (PLEG): container finished" podID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerID="b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69" exitCode=0
Jul 19 14:39:37.930646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.930336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerDied","Data":"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"}
Jul 19 14:39:37.930646 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.930638    2582 scope.go:117] "RemoveContainer" containerID="b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"
Jul 19 14:39:37.931485 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.931459    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:37.931567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.931522    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:37.931567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:37.931556    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:39:38.853142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:38.853091    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:38.939946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:38.939911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerStarted","Data":"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"}
Jul 19 14:39:39.071360 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:39.071329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:39.072545 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:39.072518    2582 patch_prober.go:28] interesting pod/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 19 14:39:39.072682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:39.072575    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 19 14:39:40.071557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:40.071480    2582 patch_prober.go:28] interesting pod/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 19 14:39:40.071557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:40.071543    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 19 14:39:41.071576 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:41.071543    2582 patch_prober.go:28] interesting pod/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 19 14:39:41.071942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:41.071594    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 19 14:39:42.071020 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:42.070986    2582 patch_prober.go:28] interesting pod/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 19 14:39:42.071176 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:42.071041    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 19 14:39:43.074598 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:43.074569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:43.074955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:43.074852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:39:43.075489 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:39:43.075474    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:40:04.532685 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:04.532644    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:40:04.533199 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:04.532881    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy" containerID="cri-o://7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1" gracePeriod=30
Jul 19 14:40:05.309028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.308999    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:05.309360 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.309348    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:05.309401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.309362    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:05.309401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.309375    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:05.309401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.309381    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:05.309488 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.309453    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:05.312717 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.312696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.314819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.314798    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-25213646-openshift-default-dockercfg-glz8b\""
Jul 19 14:40:05.323594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.323575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:05.439575 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439747 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439747 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68bjm\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.439912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.439876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.540621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68bjm\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.540848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541361 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.541141    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541361 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.541210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541361 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.541215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541361 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.541265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.541543 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.541526    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.543266 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.543246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.543499 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.543483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.548351 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.548325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.548437 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.548380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68bjm\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm\") pod \"e2e-ait-25213646-openshift-default-55868fd97-km5sz\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") " pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.623257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.623203    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:05.753542 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.753519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:05.755893 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:40:05.755867    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4589395d_9007_4700_8671_b3054b9305ca.slice/crio-77be89eff1fa69c33e81dbb8d586ca0b16af5cc93cb6d9a92bd02c1ea9c93493 WatchSource:0}: Error finding container 77be89eff1fa69c33e81dbb8d586ca0b16af5cc93cb6d9a92bd02c1ea9c93493: Status 404 returned error can't find the container with id 77be89eff1fa69c33e81dbb8d586ca0b16af5cc93cb6d9a92bd02c1ea9c93493
Jul 19 14:40:05.758383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.758354    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:05.758452 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.758415    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:05.758452 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:05.758442    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:06.073690 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:06.073635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerStarted","Data":"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"}
Jul 19 14:40:06.073884 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:06.073731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerStarted","Data":"77be89eff1fa69c33e81dbb8d586ca0b16af5cc93cb6d9a92bd02c1ea9c93493"}
Jul 19 14:40:06.093480 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:06.093434    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podStartSLOduration=1.093420433 podStartE2EDuration="1.093420433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:40:06.092057289 +0000 UTC m=+1639.375715728" watchObservedRunningTime="2026-07-19 14:40:06.093420433 +0000 UTC m=+1639.377078931"
Jul 19 14:40:06.623738 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:06.623708    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:06.628346 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:06.628323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:07.078718 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:07.078697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:07.079312 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:07.079292    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:09.781180 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.781154    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:40:09.880280 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880332    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880384    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdprv\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs\") pod \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\" (UID: \"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a\") "
Jul 19 14:40:09.880875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:09.880875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:40:09.880984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880919    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.880984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.880938    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.881089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.881075    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:09.881149 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.881110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:09.881226 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.881198    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:09.882594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.882561    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:40:09.882739 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.882649    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:40:09.882829 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.882808    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:09.882942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.882920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv" (OuterVolumeSpecName: "kube-api-access-gdprv") pod "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" (UID: "6ba2afd8-3f0d-4773-bc1b-5939ec969a9a"). InnerVolumeSpecName "kube-api-access-gdprv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:40:09.981462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981435    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981458    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981462 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981468    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981476    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981484    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdprv\" (UniqueName: \"kubernetes.io/projected/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-kube-api-access-gdprv\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981493    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:09.981631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:09.981501    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:10.096548 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.096523    2582 generic.go:356] "Generic (PLEG): container finished" podID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerID="7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1" exitCode=0
Jul 19 14:40:10.096653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.096571    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"
Jul 19 14:40:10.096653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.096612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerDied","Data":"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"}
Jul 19 14:40:10.096819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.096689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd" event={"ID":"6ba2afd8-3f0d-4773-bc1b-5939ec969a9a","Type":"ContainerDied","Data":"d8baf5715b87a4f3cbbce50d8f94e79a7332775b5550f0512cf616e121125af8"}
Jul 19 14:40:10.096819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.096713    2582 scope.go:117] "RemoveContainer" containerID="7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"
Jul 19 14:40:10.106026 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.105796    2582 scope.go:117] "RemoveContainer" containerID="b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"
Jul 19 14:40:10.113213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.113194    2582 scope.go:117] "RemoveContainer" containerID="7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"
Jul 19 14:40:10.113430 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:40:10.113413    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1\": container with ID starting with 7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1 not found: ID does not exist" containerID="7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"
Jul 19 14:40:10.113483 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.113437    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1"} err="failed to get container status \"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1\": rpc error: code = NotFound desc = could not find container \"7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1\": container with ID starting with 7527ecb61dafcdbb8eef0bf9d5537c5eaf59503a2f635cec0891e2292b7e05b1 not found: ID does not exist"
Jul 19 14:40:10.113483 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.113454    2582 scope.go:117] "RemoveContainer" containerID="b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"
Jul 19 14:40:10.113723 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:40:10.113703    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69\": container with ID starting with b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69 not found: ID does not exist" containerID="b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"
Jul 19 14:40:10.113801 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.113726    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69"} err="failed to get container status \"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69\": rpc error: code = NotFound desc = could not find container \"b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69\": container with ID starting with b7e866493e4f89947bbffee37a2dc20bde43dfe29f9a058e915a87b3f4368e69 not found: ID does not exist"
Jul 19 14:40:10.117662 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.117642    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:40:10.123314 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:10.123294    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c6a7edc8-gw-openshift-default-5648b4b5c5-lp6qd"]
Jul 19 14:40:11.246661 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:11.246629    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" path="/var/lib/kubelet/pods/6ba2afd8-3f0d-4773-bc1b-5939ec969a9a/volumes"
Jul 19 14:40:21.153200 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.153170    2582 generic.go:356] "Generic (PLEG): container finished" podID="4589395d-9007-4700-8671-b3054b9305ca" containerID="26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584" exitCode=0
Jul 19 14:40:21.153516 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.153240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerDied","Data":"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"}
Jul 19 14:40:21.153597 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.153583    2582 scope.go:117] "RemoveContainer" containerID="26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"
Jul 19 14:40:21.154529 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.154502    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:21.154584 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.154568    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:21.154618 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:21.154597    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:22.079682 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:22.079643    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:22.160369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:22.160330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerStarted","Data":"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"}
Jul 19 14:40:22.624046 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:22.624014    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:22.625043 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:22.625018    2582 patch_prober.go:28] interesting pod/e2e-ait-25213646-openshift-default-55868fd97-km5sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 19 14:40:22.625148 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:22.625068    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 19 14:40:23.623910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:23.623877    2582 patch_prober.go:28] interesting pod/e2e-ait-25213646-openshift-default-55868fd97-km5sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 19 14:40:23.624354 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:23.623934    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 19 14:40:24.624244 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:24.624206    2582 patch_prober.go:28] interesting pod/e2e-ait-25213646-openshift-default-55868fd97-km5sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 19 14:40:24.624624 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:24.624255    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 19 14:40:25.623723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:25.623690    2582 patch_prober.go:28] interesting pod/e2e-ait-25213646-openshift-default-55868fd97-km5sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 19 14:40:25.623886 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:25.623751    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 19 14:40:26.627594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:26.627557    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:26.628041 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:26.627813    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:26.628426 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:26.628410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:49.516155 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:49.516122    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:49.516592 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:49.516328    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy" containerID="cri-o://d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146" gracePeriod=30
Jul 19 14:40:50.260801 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.260771    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:40:50.261252 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261237    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261299 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261257    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261299 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261273    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261299 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261282    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261406 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261395    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261439 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261413    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba2afd8-3f0d-4773-bc1b-5939ec969a9a" containerName="istio-proxy"
Jul 19 14:40:50.261439 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.261424    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa48566-ff35-464a-b69e-25ebb0e1df79" containerName="istio-proxy"
Jul 19 14:40:50.264618 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.264597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.266567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.266543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-35312369-openshift-default-dockercfg-4qmwn\""
Jul 19 14:40:50.274995 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.274973    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:40:50.295281 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295362 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7mp\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295406 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295406 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295495 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.295594 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.295579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396168 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7mp\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396709 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396807 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396873 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.396873 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.396859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.397150 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.397127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.398720 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.398698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.398910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.398888    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.403999 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.403969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.404128 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.404112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7mp\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp\") pod \"e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") " pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.575409 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.575361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:50.711877 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.711854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:40:50.713690 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:40:50.713651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a30f15c_af41_435c_a472_84839b3a14b8.slice/crio-295bd4fd21f020fc2292a5e66b2c443313e61534d80a59170068eec64084b299 WatchSource:0}: Error finding container 295bd4fd21f020fc2292a5e66b2c443313e61534d80a59170068eec64084b299: Status 404 returned error can't find the container with id 295bd4fd21f020fc2292a5e66b2c443313e61534d80a59170068eec64084b299
Jul 19 14:40:50.716284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.716252    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:50.716358 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.716315    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:50.716398 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:50.716356    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:40:51.302129 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:51.302090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerStarted","Data":"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"}
Jul 19 14:40:51.302284 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:51.302156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerStarted","Data":"295bd4fd21f020fc2292a5e66b2c443313e61534d80a59170068eec64084b299"}
Jul 19 14:40:51.323487 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:51.323443    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podStartSLOduration=1.323430193 podStartE2EDuration="1.323430193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:40:51.32225431 +0000 UTC m=+1684.605912767" watchObservedRunningTime="2026-07-19 14:40:51.323430193 +0000 UTC m=+1684.607088637"
Jul 19 14:40:51.575556 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:51.575477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:51.579952 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:51.579928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:52.306764 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:52.306730    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:52.307565 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:52.307546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:40:54.763610 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.763586    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:54.839135 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839075    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68bjm\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839250 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839250 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839250 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839198    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839294    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo\") pod \"4589395d-9007-4700-8671-b3054b9305ca\" (UID: \"4589395d-9007-4700-8671-b3054b9305ca\") "
Jul 19 14:40:54.839603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839513    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:54.839603 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:54.839817 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839545    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:40:54.839817 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839788    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4589395d-9007-4700-8671-b3054b9305ca-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.839817 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839808    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.839979 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839822    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.839979 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.839879    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:54.840363 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.840339    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:54.841262 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.841245    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:40:54.841487 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.841466    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:40:54.841619 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.841603    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm" (OuterVolumeSpecName: "kube-api-access-68bjm") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "kube-api-access-68bjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:40:54.841732 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.841714    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "4589395d-9007-4700-8671-b3054b9305ca" (UID: "4589395d-9007-4700-8671-b3054b9305ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:40:54.940146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940127    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.940146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940147    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.940272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940156    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.940272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940164    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4589395d-9007-4700-8671-b3054b9305ca-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.940272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940171    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68bjm\" (UniqueName: \"kubernetes.io/projected/4589395d-9007-4700-8671-b3054b9305ca-kube-api-access-68bjm\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:54.940272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:54.940180    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4589395d-9007-4700-8671-b3054b9305ca-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:40:55.321320 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.321287    2582 generic.go:356] "Generic (PLEG): container finished" podID="4589395d-9007-4700-8671-b3054b9305ca" containerID="d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146" exitCode=0
Jul 19 14:40:55.321436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.321323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerDied","Data":"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"}
Jul 19 14:40:55.321436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.321346    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"
Jul 19 14:40:55.321436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.321373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz" event={"ID":"4589395d-9007-4700-8671-b3054b9305ca","Type":"ContainerDied","Data":"77be89eff1fa69c33e81dbb8d586ca0b16af5cc93cb6d9a92bd02c1ea9c93493"}
Jul 19 14:40:55.321436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.321395    2582 scope.go:117] "RemoveContainer" containerID="d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"
Jul 19 14:40:55.329875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.329861    2582 scope.go:117] "RemoveContainer" containerID="26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"
Jul 19 14:40:55.338456 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.338431    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:55.338748 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.338726    2582 scope.go:117] "RemoveContainer" containerID="d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"
Jul 19 14:40:55.339074 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:40:55.339048    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146\": container with ID starting with d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146 not found: ID does not exist" containerID="d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"
Jul 19 14:40:55.339176 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.339083    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146"} err="failed to get container status \"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146\": rpc error: code = NotFound desc = could not find container \"d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146\": container with ID starting with d5134b67a05d4f983c25acf75d62c8a74a1a10c5e9b014916bce8676d03b9146 not found: ID does not exist"
Jul 19 14:40:55.339176 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.339106    2582 scope.go:117] "RemoveContainer" containerID="26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"
Jul 19 14:40:55.339352 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:40:55.339334    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584\": container with ID starting with 26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584 not found: ID does not exist" containerID="26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"
Jul 19 14:40:55.339407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.339362    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584"} err="failed to get container status \"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584\": rpc error: code = NotFound desc = could not find container \"26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584\": container with ID starting with 26ead9020225a715ef5bd034a1646626a2a5796023384289723c137075ec1584 not found: ID does not exist"
Jul 19 14:40:55.340765 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:55.340748    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-25213646-openshift-default-55868fd97-km5sz"]
Jul 19 14:40:57.253226 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:40:57.253192    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4589395d-9007-4700-8671-b3054b9305ca" path="/var/lib/kubelet/pods/4589395d-9007-4700-8671-b3054b9305ca/volumes"
Jul 19 14:41:03.372849 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.372822    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a30f15c-af41-435c-a472-84839b3a14b8" containerID="4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664" exitCode=0
Jul 19 14:41:03.373230 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.372891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerDied","Data":"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"}
Jul 19 14:41:03.373230 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.373194    2582 scope.go:117] "RemoveContainer" containerID="4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"
Jul 19 14:41:03.374051 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.374027    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:41:03.374097 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.374088    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:41:03.374130 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:03.374123    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:41:04.379616 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:04.379580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerStarted","Data":"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"}
Jul 19 14:41:04.576119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:04.576082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:04.577120 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:04.577093    2582 patch_prober.go:28] interesting pod/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 19 14:41:04.577222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:04.577145    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 19 14:41:05.575765 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:05.575733    2582 patch_prober.go:28] interesting pod/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 19 14:41:05.576124 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:05.575785    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 19 14:41:06.575781 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:06.575745    2582 patch_prober.go:28] interesting pod/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 19 14:41:06.576143 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:06.575809    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 19 14:41:07.306907 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:07.306877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:07.575856 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:07.575769    2582 patch_prober.go:28] interesting pod/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 19 14:41:07.575856 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:07.575821    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 19 14:41:08.579662 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:08.579632    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:08.580454 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:08.580434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:32.822529 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:32.822449    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:41:32.823019 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:32.822638    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy" containerID="cri-o://23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc" gracePeriod=30
Jul 19 14:41:38.082100 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.082039    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:38.190297 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190308    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190413 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190461    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt7mp\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190481    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190496    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190510    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:38.190572 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190526    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket\") pod \"8a30f15c-af41-435c-a472-84839b3a14b8\" (UID: \"8a30f15c-af41-435c-a472-84839b3a14b8\") "
Jul 19 14:41:38.190896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190793    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.190896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:41:38.191002 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190983    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:38.191002 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.190994    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:38.191396 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.191369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:38.192498 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.192465    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:41:38.192749 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.192716    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:41:38.192971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.192946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:41:38.193052 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.192967    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp" (OuterVolumeSpecName: "kube-api-access-dt7mp") pod "8a30f15c-af41-435c-a472-84839b3a14b8" (UID: "8a30f15c-af41-435c-a472-84839b3a14b8"). InnerVolumeSpecName "kube-api-access-dt7mp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:41:38.291734 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291713    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291732    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291751    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a30f15c-af41-435c-a472-84839b3a14b8-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291760    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a30f15c-af41-435c-a472-84839b3a14b8-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291767    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt7mp\" (UniqueName: \"kubernetes.io/projected/8a30f15c-af41-435c-a472-84839b3a14b8-kube-api-access-dt7mp\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291775    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291783    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.291818 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.291790    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a30f15c-af41-435c-a472-84839b3a14b8-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:41:38.544830 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.544802    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a30f15c-af41-435c-a472-84839b3a14b8" containerID="23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc" exitCode=0
Jul 19 14:41:38.544971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.544845    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"
Jul 19 14:41:38.544971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.544890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerDied","Data":"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"}
Jul 19 14:41:38.544971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.544938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v" event={"ID":"8a30f15c-af41-435c-a472-84839b3a14b8","Type":"ContainerDied","Data":"295bd4fd21f020fc2292a5e66b2c443313e61534d80a59170068eec64084b299"}
Jul 19 14:41:38.544971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.544959    2582 scope.go:117] "RemoveContainer" containerID="23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"
Jul 19 14:41:38.553503 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.553483    2582 scope.go:117] "RemoveContainer" containerID="4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"
Jul 19 14:41:38.560797 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.560781    2582 scope.go:117] "RemoveContainer" containerID="23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"
Jul 19 14:41:38.561011 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:41:38.560992    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc\": container with ID starting with 23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc not found: ID does not exist" containerID="23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"
Jul 19 14:41:38.561080 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.561022    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc"} err="failed to get container status \"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc\": rpc error: code = NotFound desc = could not find container \"23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc\": container with ID starting with 23fc5593ab2df8486bc022ce8fa4fd160669111db3d91c60a378106e555105dc not found: ID does not exist"
Jul 19 14:41:38.561080 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.561047    2582 scope.go:117] "RemoveContainer" containerID="4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"
Jul 19 14:41:38.561268 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:41:38.561253    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664\": container with ID starting with 4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664 not found: ID does not exist" containerID="4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"
Jul 19 14:41:38.561309 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.561274    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664"} err="failed to get container status \"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664\": rpc error: code = NotFound desc = could not find container \"4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664\": container with ID starting with 4d9bac50458a15ba8c06f9cc2f19e82ad862238ef5b7ceed657ecdd43a7b3664 not found: ID does not exist"
Jul 19 14:41:38.565137 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.565117    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:41:38.568404 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:38.568383    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-35312369-openshift-default-74d78c99f9-hrh8v"]
Jul 19 14:41:39.247658 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:41:39.247634    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" path="/var/lib/kubelet/pods/8a30f15c-af41-435c-a472-84839b3a14b8/volumes"
Jul 19 14:42:47.298946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:42:47.298918    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:42:47.309338 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:42:47.309317    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:43:08.711472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711436    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711791    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711803    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711823    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711828    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711836    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711841    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711847    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.711874 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711852    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.712119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711913    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.712119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711920    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4589395d-9007-4700-8671-b3054b9305ca" containerName="istio-proxy"
Jul 19 14:43:08.712119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711929    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.712119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.711936    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a30f15c-af41-435c-a472-84839b3a14b8" containerName="istio-proxy"
Jul 19 14:43:08.715087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.715066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.717473 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.717450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b3de6a98-openshift-default-dockercfg-lczr5\""
Jul 19 14:43:08.735218 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.735197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:08.777414 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777644 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777785 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777820 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5q2\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.777857 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.777844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.878868 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.878834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879040 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.878875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879040 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.878902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879040 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.878947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879040 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879107    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5q2\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879504 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879504 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879614 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.879951 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.879912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.880085 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.880044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.881283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.881264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.882053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.882033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.886842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.886820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5q2\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:08.887108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:08.887090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token\") pod \"e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") " pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:09.025380 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.025286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:09.190114 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.190072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:09.192735 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:43:09.192696    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a1da7c_8437_425b_b863_8ba1e4f82824.slice/crio-7dbf6fc0ab1e539ba22f45d04bda8ace53a135d9f4c0ecfc47c6486e17b8b932 WatchSource:0}: Error finding container 7dbf6fc0ab1e539ba22f45d04bda8ace53a135d9f4c0ecfc47c6486e17b8b932: Status 404 returned error can't find the container with id 7dbf6fc0ab1e539ba22f45d04bda8ace53a135d9f4c0ecfc47c6486e17b8b932
Jul 19 14:43:09.195017 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.194977    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:09.195100 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.195071    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:09.195142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.195124    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:09.973197 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.973160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerStarted","Data":"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"}
Jul 19 14:43:09.973571 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.973234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerStarted","Data":"7dbf6fc0ab1e539ba22f45d04bda8ace53a135d9f4c0ecfc47c6486e17b8b932"}
Jul 19 14:43:09.997220 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:09.997177    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podStartSLOduration=1.997161804 podStartE2EDuration="1.997161804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:43:09.99621603 +0000 UTC m=+1823.279874476" watchObservedRunningTime="2026-07-19 14:43:09.997161804 +0000 UTC m=+1823.280820249"
Jul 19 14:43:10.025922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:10.025890    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:10.026836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:10.026810    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 19 14:43:10.026948 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:10.026864    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 19 14:43:11.032016 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:11.031977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:11.983310 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:11.983275    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:11.984186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:11.984164    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:27.967623 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:27.966273    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:48148->10.132.0.46:15021: read: connection reset by peer" start-of-body=
Jul 19 14:43:27.967623 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:27.966329    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:48148->10.132.0.46:15021: read: connection reset by peer"
Jul 19 14:43:28.087896 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.087872    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerID="841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53" exitCode=0
Jul 19 14:43:28.087986 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.087950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerDied","Data":"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"}
Jul 19 14:43:28.088315 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.088300    2582 scope.go:117] "RemoveContainer" containerID="841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"
Jul 19 14:43:28.089240 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.089215    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:28.089295 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.089281    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:28.089329 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:28.089310    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:43:29.094550 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:29.094513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerStarted","Data":"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"}
Jul 19 14:43:30.025737 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:30.025700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:30.026049 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:30.026022    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 19 14:43:30.026225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:30.026202    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 19 14:43:31.025866 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:31.025825    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 19 14:43:31.026324 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:31.025921    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 19 14:43:32.025835 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:32.025796    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 19 14:43:32.026038 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:32.025855    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 19 14:43:33.028897 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:33.028867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:33.029346 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:33.029327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:33.029901 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:33.029884    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:45.120183 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:45.120145    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:45.120553 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:45.120336    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" containerID="cri-o://cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf" gracePeriod=30
Jul 19 14:43:48.031477 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:48.031442    2582 patch_prober.go:28] interesting pod/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 14:43:48.031849 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:48.031515    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:43:50.373369 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.373342    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:50.508798 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.508774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.508942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.508822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.508942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.508841    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr5q2\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.508942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.508862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.508971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token\") pod \"e8a1da7c-8437-425b-b863-8ba1e4f82824\" (UID: \"e8a1da7c-8437-425b-b863-8ba1e4f82824\") "
Jul 19 14:43:50.509366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:43:50.509419 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509360    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:43:50.509419 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509376    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:50.509519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509461    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.509519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509478    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.509519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509490    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8a1da7c-8437-425b-b863-8ba1e4f82824-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.509694 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.509567    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:43:50.510309 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.510281    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:43:50.510934 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.510904    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:43:50.511043 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.511012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2" (OuterVolumeSpecName: "kube-api-access-gr5q2") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "kube-api-access-gr5q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:43:50.511090 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.511060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:43:50.511279 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.511264    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8a1da7c-8437-425b-b863-8ba1e4f82824" (UID: "e8a1da7c-8437-425b-b863-8ba1e4f82824"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:43:50.609900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609878    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.609900 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609898    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.610021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609906    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr5q2\" (UniqueName: \"kubernetes.io/projected/e8a1da7c-8437-425b-b863-8ba1e4f82824-kube-api-access-gr5q2\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.610021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609915    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.610021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609924    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:50.610021 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:50.609932    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8a1da7c-8437-425b-b863-8ba1e4f82824-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:43:51.197432 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.197408    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerID="cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf" exitCode=0
Jul 19 14:43:51.197554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.197465    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"
Jul 19 14:43:51.197554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.197503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerDied","Data":"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"}
Jul 19 14:43:51.197631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.197573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n" event={"ID":"e8a1da7c-8437-425b-b863-8ba1e4f82824","Type":"ContainerDied","Data":"7dbf6fc0ab1e539ba22f45d04bda8ace53a135d9f4c0ecfc47c6486e17b8b932"}
Jul 19 14:43:51.197631 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.197596    2582 scope.go:117] "RemoveContainer" containerID="cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"
Jul 19 14:43:51.206352 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.206333    2582 scope.go:117] "RemoveContainer" containerID="841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"
Jul 19 14:43:51.213845 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.213829    2582 scope.go:117] "RemoveContainer" containerID="cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"
Jul 19 14:43:51.214093 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:43:51.214074    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf\": container with ID starting with cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf not found: ID does not exist" containerID="cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"
Jul 19 14:43:51.214140 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.214099    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf"} err="failed to get container status \"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf\": rpc error: code = NotFound desc = could not find container \"cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf\": container with ID starting with cbdd8a60edc28f654682b8f5c078ef637eb03601e9c9283bafd19d6dca4c0edf not found: ID does not exist"
Jul 19 14:43:51.214140 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.214116    2582 scope.go:117] "RemoveContainer" containerID="841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"
Jul 19 14:43:51.214326 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:43:51.214309    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53\": container with ID starting with 841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53 not found: ID does not exist" containerID="841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"
Jul 19 14:43:51.214383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.214334    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53"} err="failed to get container status \"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53\": rpc error: code = NotFound desc = could not find container \"841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53\": container with ID starting with 841e78e09bd52f606b0f43fef19ec9fb9fcc9573845843b8d270da07c5eebb53 not found: ID does not exist"
Jul 19 14:43:51.217147 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.217127    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:51.222912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.222893    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b3de6a98-openshift-default-5654fd6f5-5nv6n"]
Jul 19 14:43:51.247397 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:43:51.247375    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" path="/var/lib/kubelet/pods/e8a1da7c-8437-425b-b863-8ba1e4f82824/volumes"
Jul 19 14:44:04.321914 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.321880    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:44:04.322331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.322213    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:04.322331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.322224    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:04.322331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.322239    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:04.322331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.322245    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:04.322331 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.322297    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:04.326626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.326608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.328971 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.328949    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e1c86cb1-openshift-default-dockercfg-b5cnk\""
Jul 19 14:44:04.335149 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.335127    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:44:04.413831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.413946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.413946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.413946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.414115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.414115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.413978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.414115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.414002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.414115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.414024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.414115 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.414071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2tfw\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515183 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2tfw\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515786 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515853 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.515955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.515890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.516396 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.516366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.518848 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.518823    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.518966 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.518947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.522291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.522270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.522461 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.522441    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2tfw\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw\") pod \"e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") " pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.638302 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.638274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:04.771119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.771094    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:44:04.772784 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:44:04.772757    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4611c7a0_c86a_4869_be60_91f25262126d.slice/crio-e64b00af8cb74e9fa637561fcd226feac8e21c537f9418094526659ccad99db3 WatchSource:0}: Error finding container e64b00af8cb74e9fa637561fcd226feac8e21c537f9418094526659ccad99db3: Status 404 returned error can't find the container with id e64b00af8cb74e9fa637561fcd226feac8e21c537f9418094526659ccad99db3
Jul 19 14:44:04.774852 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.774817    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:04.774946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.774877    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:04.774946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:04.774902    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:05.276005 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:05.275979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerStarted","Data":"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"}
Jul 19 14:44:05.276187 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:05.276024    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerStarted","Data":"e64b00af8cb74e9fa637561fcd226feac8e21c537f9418094526659ccad99db3"}
Jul 19 14:44:05.294952 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:05.294904    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podStartSLOduration=1.2948907539999999 podStartE2EDuration="1.294890754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:44:05.292906616 +0000 UTC m=+1878.576565063" watchObservedRunningTime="2026-07-19 14:44:05.294890754 +0000 UTC m=+1878.578549200"
Jul 19 14:44:05.638997 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:05.638973    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:05.643796 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:05.643775    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:06.280889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:06.280860    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:06.281704 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:06.281684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:20.349567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.349539    2582 generic.go:356] "Generic (PLEG): container finished" podID="4611c7a0-c86a-4869-be60-91f25262126d" containerID="12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38" exitCode=0
Jul 19 14:44:20.349981 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.349600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerDied","Data":"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"}
Jul 19 14:44:20.349981 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.349883    2582 scope.go:117] "RemoveContainer" containerID="12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"
Jul 19 14:44:20.350789 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.350761    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:20.350858 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.350842    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:20.350904 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:20.350888    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:44:21.281428 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.281397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:21.357042 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.357006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerStarted","Data":"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"}
Jul 19 14:44:21.639416 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.639376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:21.640758 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.640726    2582 patch_prober.go:28] interesting pod/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 19 14:44:21.640990 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.640961    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 19 14:44:21.905315 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.905237    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:44:21.905650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.905638    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a1da7c-8437-425b-b863-8ba1e4f82824" containerName="istio-proxy"
Jul 19 14:44:21.909087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.909070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.911142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.911118    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1c86cb1\"/\"openshift-service-ca.crt\""
Jul 19 14:44:21.911960 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.911922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1c86cb1\"/\"default-dockercfg-pb7nk\""
Jul 19 14:44:21.911960 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.911953    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e1c86cb1\"/\"kube-root-ca.crt\""
Jul 19 14:44:21.912142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.911956    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e1c86cb1\"/\"e2e-lifecycle-model-e1c86cb1-kserve-self-signed-certs\""
Jul 19 14:44:21.915451 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.915430    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:44:21.949961 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.949927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.950256 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.950235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.950392 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.950377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.950544 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.950530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.950756 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.950728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:21.950901 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:21.950883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv2fh\" (UniqueName: \"kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052214 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv2fh\" (UniqueName: \"kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052543 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052543 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052543 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052778 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052778 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.052893 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.052790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.054601 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.054575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.054783 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.054695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.059368 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.059329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv2fh\" (UniqueName: \"kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh\") pod \"e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") " pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.219661 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.219589    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:22.394549 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.394516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:44:22.397432 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:44:22.397395    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9834db24_a629_48bc_b72c_e657edd159e4.slice/crio-00653c737f1c6aabd8ee6a84b4253a2d948029daf5984018f741811c34164c2f WatchSource:0}: Error finding container 00653c737f1c6aabd8ee6a84b4253a2d948029daf5984018f741811c34164c2f: Status 404 returned error can't find the container with id 00653c737f1c6aabd8ee6a84b4253a2d948029daf5984018f741811c34164c2f
Jul 19 14:44:22.639570 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.639528    2582 patch_prober.go:28] interesting pod/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 19 14:44:22.639774 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:22.639592    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 19 14:44:23.369702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:23.369644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" event={"ID":"9834db24-a629-48bc-b72c-e657edd159e4","Type":"ContainerStarted","Data":"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"}
Jul 19 14:44:23.369702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:23.369706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" event={"ID":"9834db24-a629-48bc-b72c-e657edd159e4","Type":"ContainerStarted","Data":"00653c737f1c6aabd8ee6a84b4253a2d948029daf5984018f741811c34164c2f"}
Jul 19 14:44:23.386206 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:23.386162    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" podStartSLOduration=2.386148612 podStartE2EDuration="2.386148612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:44:23.384227071 +0000 UTC m=+1896.667885517" watchObservedRunningTime="2026-07-19 14:44:23.386148612 +0000 UTC m=+1896.669807058"
Jul 19 14:44:23.639345 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:23.639316    2582 patch_prober.go:28] interesting pod/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 19 14:44:23.639897 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:23.639867    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 19 14:44:24.639710 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:24.639655    2582 patch_prober.go:28] interesting pod/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 19 14:44:24.640283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:24.640242    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 19 14:44:25.642313 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:25.642282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:25.642746 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:25.642569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:25.643193 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:25.643174    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:44:32.219922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:32.219888    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:32.219922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:32.219927    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:32.231433 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:32.231410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:44:32.421746 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:44:32.421725    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:45:12.275295 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:12.275253    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:45:27.296809 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.296758    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" podUID="9834db24-a629-48bc-b72c-e657edd159e4" containerName="main" containerID="cri-o://f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc" gracePeriod=45
Jul 19 14:45:27.541843 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.541818    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:45:27.645989 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.645967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.645995    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646034    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646245 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646132    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646245 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv2fh\" (UniqueName: \"kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh\") pod \"9834db24-a629-48bc-b72c-e657edd159e4\" (UID: \"9834db24-a629-48bc-b72c-e657edd159e4\") "
Jul 19 14:45:27.646322 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646235    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home" (OuterVolumeSpecName: "home") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:45:27.646359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646317    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:45:27.646449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646413    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:45:27.646508 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646498    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-model-cache\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:27.646561 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646511    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-home\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:27.646561 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.646524    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-tmp-dir\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:27.648155 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.648128    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm" (OuterVolumeSpecName: "dshm") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:45:27.648268 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.648203    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:45:27.648268 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.648227    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh" (OuterVolumeSpecName: "kube-api-access-jv2fh") pod "9834db24-a629-48bc-b72c-e657edd159e4" (UID: "9834db24-a629-48bc-b72c-e657edd159e4"). InnerVolumeSpecName "kube-api-access-jv2fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:45:27.665093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.665066    2582 generic.go:356] "Generic (PLEG): container finished" podID="9834db24-a629-48bc-b72c-e657edd159e4" containerID="f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc" exitCode=0
Jul 19 14:45:27.665189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.665099    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"
Jul 19 14:45:27.665189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.665111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" event={"ID":"9834db24-a629-48bc-b72c-e657edd159e4","Type":"ContainerDied","Data":"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"}
Jul 19 14:45:27.665189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.665154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj" event={"ID":"9834db24-a629-48bc-b72c-e657edd159e4","Type":"ContainerDied","Data":"00653c737f1c6aabd8ee6a84b4253a2d948029daf5984018f741811c34164c2f"}
Jul 19 14:45:27.665189 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.665172    2582 scope.go:117] "RemoveContainer" containerID="f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"
Jul 19 14:45:27.673872 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.673857    2582 scope.go:117] "RemoveContainer" containerID="f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"
Jul 19 14:45:27.674105 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:45:27.674087    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc\": container with ID starting with f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc not found: ID does not exist" containerID="f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"
Jul 19 14:45:27.674153 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.674111    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc"} err="failed to get container status \"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc\": rpc error: code = NotFound desc = could not find container \"f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc\": container with ID starting with f0fa1a8be813ab968c5f3a8fde59f2fa79686c41a189c3b5d7fd0400ee7a53fc not found: ID does not exist"
Jul 19 14:45:27.684507 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.684488    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:45:27.689607 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.689587    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e1c86cb1/e2e-lifecycle-model-e1c86cb1-kserve-6959f8c6b7-4kftj"]
Jul 19 14:45:27.747589 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.747570    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9834db24-a629-48bc-b72c-e657edd159e4-tls-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:27.747589 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.747587    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv2fh\" (UniqueName: \"kubernetes.io/projected/9834db24-a629-48bc-b72c-e657edd159e4-kube-api-access-jv2fh\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:27.747732 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:27.747596    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9834db24-a629-48bc-b72c-e657edd159e4-dshm\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:45:29.247049 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:29.247012    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9834db24-a629-48bc-b72c-e657edd159e4" path="/var/lib/kubelet/pods/9834db24-a629-48bc-b72c-e657edd159e4/volumes"
Jul 19 14:45:54.864989 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:54.864957    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:45:54.865388 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:54.865163    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" containerID="cri-o://f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c" gracePeriod=30
Jul 19 14:45:55.644888 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:55.644851    2582 patch_prober.go:28] interesting pod/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 14:45:55.645057 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:45:55.644907    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:46:00.122653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.122628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:46:00.184316 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184339    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184369    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184422    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184465    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184551    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184575    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2tfw\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw\") pod \"4611c7a0-c86a-4869-be60-91f25262126d\" (UID: \"4611c7a0-c86a-4869-be60-91f25262126d\") "
Jul 19 14:46:00.184723 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184623    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:46:00.185212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184844    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:46:00.185212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184915    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:46:00.185212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.184983    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.185212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.185004    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.185423 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.185237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:46:00.185617 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.185580    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data" (OuterVolumeSpecName: "istio-data") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:46:00.186566 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.186535    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:46:00.186863 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.186845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw" (OuterVolumeSpecName: "kube-api-access-k2tfw") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "kube-api-access-k2tfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:46:00.186957 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.186941    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:46:00.187196 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.187180    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4611c7a0-c86a-4869-be60-91f25262126d" (UID: "4611c7a0-c86a-4869-be60-91f25262126d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:46:00.285608 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285574    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4611c7a0-c86a-4869-be60-91f25262126d-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285608 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285601    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285608 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285611    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4611c7a0-c86a-4869-be60-91f25262126d-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285622    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285635    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2tfw\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-kube-api-access-k2tfw\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285648    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4611c7a0-c86a-4869-be60-91f25262126d-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.285842 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.285660    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4611c7a0-c86a-4869-be60-91f25262126d-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:46:00.822303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.822270    2582 generic.go:356] "Generic (PLEG): container finished" podID="4611c7a0-c86a-4869-be60-91f25262126d" containerID="f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c" exitCode=0
Jul 19 14:46:00.822472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.822317    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"
Jul 19 14:46:00.822472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.822319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerDied","Data":"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"}
Jul 19 14:46:00.822472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.822430    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4" event={"ID":"4611c7a0-c86a-4869-be60-91f25262126d","Type":"ContainerDied","Data":"e64b00af8cb74e9fa637561fcd226feac8e21c537f9418094526659ccad99db3"}
Jul 19 14:46:00.822472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.822459    2582 scope.go:117] "RemoveContainer" containerID="f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"
Jul 19 14:46:00.831464 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.831448    2582 scope.go:117] "RemoveContainer" containerID="12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"
Jul 19 14:46:00.838653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.838638    2582 scope.go:117] "RemoveContainer" containerID="f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"
Jul 19 14:46:00.838908 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:46:00.838889    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c\": container with ID starting with f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c not found: ID does not exist" containerID="f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"
Jul 19 14:46:00.838970 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.838914    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c"} err="failed to get container status \"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c\": rpc error: code = NotFound desc = could not find container \"f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c\": container with ID starting with f94ad9d0c79b4a0fa2b40352c97e04878a84d609750385b902e9590425140e3c not found: ID does not exist"
Jul 19 14:46:00.838970 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.838931    2582 scope.go:117] "RemoveContainer" containerID="12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"
Jul 19 14:46:00.839159 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:46:00.839142    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38\": container with ID starting with 12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38 not found: ID does not exist" containerID="12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"
Jul 19 14:46:00.839199 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.839165    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38"} err="failed to get container status \"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38\": rpc error: code = NotFound desc = could not find container \"12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38\": container with ID starting with 12e7cf70712fa91440eab34267057eeb7ebe1c3fba94fe12d1ec6f33a6d4af38 not found: ID does not exist"
Jul 19 14:46:00.842559 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.842537    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:46:00.848234 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:00.848214    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e1c86cb1-openshift-default-67776b8659-pvfm4"]
Jul 19 14:46:01.246989 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:01.246963    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4611c7a0-c86a-4869-be60-91f25262126d" path="/var/lib/kubelet/pods/4611c7a0-c86a-4869-be60-91f25262126d/volumes"
Jul 19 14:46:50.063528 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063496    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063846    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9834db24-a629-48bc-b72c-e657edd159e4" containerName="main"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063858    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9834db24-a629-48bc-b72c-e657edd159e4" containerName="main"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063879    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063884    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063890    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063895    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063948    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063955    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9834db24-a629-48bc-b72c-e657edd159e4" containerName="main"
Jul 19 14:46:50.064004 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.063963    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4611c7a0-c86a-4869-be60-91f25262126d" containerName="istio-proxy"
Jul 19 14:46:50.068308 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.068281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.070513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.070492    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-763d0d-openshift-default-dockercfg-qsd86\""
Jul 19 14:46:50.076286 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.076264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:46:50.169081 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lf8v\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169201 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169385 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169385 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.169385 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.169260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.270735 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.270886 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.270886 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lf8v\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.270886 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271020 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271020 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.270941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271170 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271220 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271272 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271326 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271576 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.271728 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.271711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.273089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.273072    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.273280 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.273264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.285550 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.285522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lf8v\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.285767 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.285747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token\") pod \"e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") " pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.380221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.380202    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:50.509079 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.509056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:46:50.511118 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:46:50.511092    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10396275_2258_4e21_8c9a_e79c0950fd60.slice/crio-70d3a346f3bc0c88b04430d209f1924ba7c63be99a9ce706af864d8d8f24d711 WatchSource:0}: Error finding container 70d3a346f3bc0c88b04430d209f1924ba7c63be99a9ce706af864d8d8f24d711: Status 404 returned error can't find the container with id 70d3a346f3bc0c88b04430d209f1924ba7c63be99a9ce706af864d8d8f24d711
Jul 19 14:46:50.513117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.513085    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:50.513190 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.513150    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:50.513190 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:50.513177    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:51.059990 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:51.059961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerStarted","Data":"211e9bb7be3ae29a5988044eaa4f36f952e642412d56c81294e6945e8f7f0cc2"}
Jul 19 14:46:51.060198 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:51.060013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerStarted","Data":"70d3a346f3bc0c88b04430d209f1924ba7c63be99a9ce706af864d8d8f24d711"}
Jul 19 14:46:51.080068 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:51.080025    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podStartSLOduration=1.079985589 podStartE2EDuration="1.079985589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:51.078437859 +0000 UTC m=+2044.362096304" watchObservedRunningTime="2026-07-19 14:46:51.079985589 +0000 UTC m=+2044.363644034"
Jul 19 14:46:51.380866 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:51.380845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:51.385227 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:51.385206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:52.064935 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:52.064904    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:52.065677 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:52.065650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:46:58.128599 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.128565    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:46:58.132469 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.132445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.134540 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.134521    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a96ad8-openshift-default-dockercfg-qgqbb\""
Jul 19 14:46:58.143887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.143865    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:46:58.232103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.231955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9fwl\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.232410 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.232342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.332788 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.332759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.332943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.332818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.332943 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.332923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.332954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9fwl\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.332977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333368 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333368 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333527 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333527 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.333801 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.333781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.335077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.335058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.335441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.335422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.340131 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.340104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.340335 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.340310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9fwl\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl\") pod \"e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") " pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.443142 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.443102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:58.603597 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.603568    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:46:58.607105 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:46:58.607073    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cfaaf7_7534_408a_bed0_94d7a658538c.slice/crio-c2e2eb5fbfc852955c450d3391bba4f044cace40b16a3fca851c3ffbfdb81afa WatchSource:0}: Error finding container c2e2eb5fbfc852955c450d3391bba4f044cace40b16a3fca851c3ffbfdb81afa: Status 404 returned error can't find the container with id c2e2eb5fbfc852955c450d3391bba4f044cace40b16a3fca851c3ffbfdb81afa
Jul 19 14:46:58.609370 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.609338    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:58.609463 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.609402    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:58.609463 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:58.609427    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:46:59.097773 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:59.097734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerStarted","Data":"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"}
Jul 19 14:46:59.097919 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:59.097793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerStarted","Data":"c2e2eb5fbfc852955c450d3391bba4f044cace40b16a3fca851c3ffbfdb81afa"}
Jul 19 14:46:59.117015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:59.116973    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podStartSLOduration=1.116957801 podStartE2EDuration="1.116957801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:46:59.114430538 +0000 UTC m=+2052.398088994" watchObservedRunningTime="2026-07-19 14:46:59.116957801 +0000 UTC m=+2052.400616246"
Jul 19 14:46:59.444841 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:59.444813    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:46:59.453530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:46:59.453508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:00.102831 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:00.102806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:00.103691 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:00.103659    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:06.133578 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.133545    2582 generic.go:356] "Generic (PLEG): container finished" podID="10396275-2258-4e21-8c9a-e79c0950fd60" containerID="211e9bb7be3ae29a5988044eaa4f36f952e642412d56c81294e6945e8f7f0cc2" exitCode=0
Jul 19 14:47:06.133988 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.133584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerDied","Data":"211e9bb7be3ae29a5988044eaa4f36f952e642412d56c81294e6945e8f7f0cc2"}
Jul 19 14:47:06.134033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.133997    2582 scope.go:117] "RemoveContainer" containerID="211e9bb7be3ae29a5988044eaa4f36f952e642412d56c81294e6945e8f7f0cc2"
Jul 19 14:47:06.134906 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.134878    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:06.135010 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.134955    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:06.135072 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:06.135016    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:07.065504 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:07.065461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:47:07.144317 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:07.144278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerStarted","Data":"e83ff45d4cd527594b5e020b352b4ef23afda157550d061542b92920133db8d7"}
Jul 19 14:47:07.380571 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:07.380530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:47:07.381920 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:07.381891    2582 patch_prober.go:28] interesting pod/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 19 14:47:07.382041 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:07.381942    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 19 14:47:08.381071 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:08.381035    2582 patch_prober.go:28] interesting pod/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 19 14:47:08.381422 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:08.381102    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 19 14:47:09.380911 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:09.380880    2582 patch_prober.go:28] interesting pod/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 19 14:47:09.381143 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:09.381121    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 19 14:47:10.381541 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:10.381502    2582 patch_prober.go:28] interesting pod/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 19 14:47:10.381951 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:10.381555    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 19 14:47:11.386783 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:11.386035    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:47:11.391685 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:11.387561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:47:11.394741 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:11.394717    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:47:14.188209 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.188180    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerID="c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd" exitCode=0
Jul 19 14:47:14.188574 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.188252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerDied","Data":"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"}
Jul 19 14:47:14.188645 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.188629    2582 scope.go:117] "RemoveContainer" containerID="c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"
Jul 19 14:47:14.189563 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.189536    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:14.189621 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.189603    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:14.189656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:14.189640    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:47:15.103456 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:15.103414    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:15.194552 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:15.194514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerStarted","Data":"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"}
Jul 19 14:47:15.444285 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:15.444251    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:15.445514 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:15.445480    2582 patch_prober.go:28] interesting pod/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 19 14:47:15.445650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:15.445544    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 19 14:47:16.444767 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:16.444291    2582 patch_prober.go:28] interesting pod/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 19 14:47:16.444767 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:16.444360    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 19 14:47:17.444522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:17.444481    2582 patch_prober.go:28] interesting pod/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 19 14:47:17.444737 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:17.444553    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 19 14:47:18.443686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:18.443631    2582 patch_prober.go:28] interesting pod/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 19 14:47:18.444156 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:18.443707    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 19 14:47:19.447268 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:19.447242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:19.447626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:19.447493    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:19.448064 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:19.448049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:47:47.328616 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:47.328589    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:47:47.340797 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:47:47.340775    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:48:16.358719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:16.358632    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:48:16.359186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:16.358905    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy" containerID="cri-o://e83ff45d4cd527594b5e020b352b4ef23afda157550d061542b92920133db8d7" gracePeriod=30
Jul 19 14:48:21.495982 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.495954    2582 generic.go:356] "Generic (PLEG): container finished" podID="10396275-2258-4e21-8c9a-e79c0950fd60" containerID="e83ff45d4cd527594b5e020b352b4ef23afda157550d061542b92920133db8d7" exitCode=0
Jul 19 14:48:21.496312 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.496025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerDied","Data":"e83ff45d4cd527594b5e020b352b4ef23afda157550d061542b92920133db8d7"}
Jul 19 14:48:21.496312 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.496089    2582 scope.go:117] "RemoveContainer" containerID="211e9bb7be3ae29a5988044eaa4f36f952e642412d56c81294e6945e8f7f0cc2"
Jul 19 14:48:21.607656 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.607628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:48:21.714942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.714917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.714950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.714989    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715168 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715151    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715217 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715182    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715217 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715206    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715318 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715227    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lf8v\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715318 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715318 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715273    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:21.715318 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket\") pod \"10396275-2258-4e21-8c9a-e79c0950fd60\" (UID: \"10396275-2258-4e21-8c9a-e79c0950fd60\") "
Jul 19 14:48:21.715505 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715449    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:21.715633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715585    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.715633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715610    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.715812 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715645    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:21.715812 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.715784    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:48:21.716186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.716166    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data" (OuterVolumeSpecName: "istio-data") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:21.717353 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.717332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token" (OuterVolumeSpecName: "istio-token") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:21.717482 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.717329    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v" (OuterVolumeSpecName: "kube-api-access-6lf8v") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "kube-api-access-6lf8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:21.717530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.717484    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:48:21.717530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.717499    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10396275-2258-4e21-8c9a-e79c0950fd60" (UID: "10396275-2258-4e21-8c9a-e79c0950fd60"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:21.816705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816683    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10396275-2258-4e21-8c9a-e79c0950fd60-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816705 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816704    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816713    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lf8v\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-kube-api-access-6lf8v\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816723    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10396275-2258-4e21-8c9a-e79c0950fd60-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816731    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816739    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10396275-2258-4e21-8c9a-e79c0950fd60-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:21.816821 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:21.816747    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10396275-2258-4e21-8c9a-e79c0950fd60-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:22.502015 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:22.501986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l" event={"ID":"10396275-2258-4e21-8c9a-e79c0950fd60","Type":"ContainerDied","Data":"70d3a346f3bc0c88b04430d209f1924ba7c63be99a9ce706af864d8d8f24d711"}
Jul 19 14:48:22.502394 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:22.502035    2582 scope.go:117] "RemoveContainer" containerID="e83ff45d4cd527594b5e020b352b4ef23afda157550d061542b92920133db8d7"
Jul 19 14:48:22.502394 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:22.501994    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"
Jul 19 14:48:22.522746 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:22.522724    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:48:22.528012 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:22.527993    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-763d0d-openshift-default-7d9fc6ff4f-2869l"]
Jul 19 14:48:23.246418 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:23.246391    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" path="/var/lib/kubelet/pods/10396275-2258-4e21-8c9a-e79c0950fd60/volumes"
Jul 19 14:48:38.035026 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.034991    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:48:38.035427 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.035186    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy" containerID="cri-o://5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33" gracePeriod=30
Jul 19 14:48:38.951304 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951275    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:48:38.951626 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951615    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.951687 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951628    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.951687 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951638    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.951687 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951643    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.951784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951714    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.951784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.951725    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="10396275-2258-4e21-8c9a-e79c0950fd60" containerName="istio-proxy"
Jul 19 14:48:38.955921 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.955902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:38.958073 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.958053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8e7a06-openshift-default-dockercfg-sk9td\""
Jul 19 14:48:38.965733 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:38.965709    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:48:39.045134 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts4dn\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.045522 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.045359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146303 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts4dn\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146449 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146769 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146769 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146848 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146848 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146804    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.146912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.146881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.147119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.147095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.147221 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.147175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.148830 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.148808    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.148917 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.148876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.153712 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.153689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.153799 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.153744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts4dn\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn\") pod \"e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") " pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.267368 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.267303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:39.398014 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.397990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:48:39.400290 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:48:39.400265    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05723aa0_2527_49cd_8a29_e1bf6b5c0876.slice/crio-a3f36572a7501da17b002fc23a9ad847b036620e279122df9b5423619dd7f288 WatchSource:0}: Error finding container a3f36572a7501da17b002fc23a9ad847b036620e279122df9b5423619dd7f288: Status 404 returned error can't find the container with id a3f36572a7501da17b002fc23a9ad847b036620e279122df9b5423619dd7f288
Jul 19 14:48:39.402412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.402382    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:39.402490 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.402442    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:39.402490 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.402469    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:39.583116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.583020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerStarted","Data":"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"}
Jul 19 14:48:39.583116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.583075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerStarted","Data":"a3f36572a7501da17b002fc23a9ad847b036620e279122df9b5423619dd7f288"}
Jul 19 14:48:39.601558 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:39.601512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podStartSLOduration=1.601497744 podStartE2EDuration="1.601497744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:48:39.598784559 +0000 UTC m=+2152.882443004" watchObservedRunningTime="2026-07-19 14:48:39.601497744 +0000 UTC m=+2152.885156189"
Jul 19 14:48:40.267876 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:40.267843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:40.272083 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:40.272060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:40.587808 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:40.587732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:40.588568 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:40.588552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:43.290922 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.290899    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:48:43.381579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381589    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9fwl\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381706    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381719 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.381973 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.381746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.382103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382049    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:43.382103 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382080    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382176    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382246    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data\") pod \"a5cfaaf7-7534-408a-bed0-94d7a658538c\" (UID: \"a5cfaaf7-7534-408a-bed0-94d7a658538c\") "
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382484    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382578    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfaaf7-7534-408a-bed0-94d7a658538c-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382598    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382614    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.382745 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.382628    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.383274 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.383244    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:43.383956 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.383931    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:43.384059 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.384012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:48:43.384180 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.384161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:43.384400 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.384381    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl" (OuterVolumeSpecName: "kube-api-access-w9fwl") pod "a5cfaaf7-7534-408a-bed0-94d7a658538c" (UID: "a5cfaaf7-7534-408a-bed0-94d7a658538c"). InnerVolumeSpecName "kube-api-access-w9fwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:43.483860 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.483837    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.483860 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.483857    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.483984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.483866    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9fwl\" (UniqueName: \"kubernetes.io/projected/a5cfaaf7-7534-408a-bed0-94d7a658538c-kube-api-access-w9fwl\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.483984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.483874    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.483984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.483882    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfaaf7-7534-408a-bed0-94d7a658538c-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:48:43.602910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.602886    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerID="5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33" exitCode=0
Jul 19 14:48:43.603003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.602934    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"
Jul 19 14:48:43.603003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.602965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerDied","Data":"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"}
Jul 19 14:48:43.603071 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.603018    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4" event={"ID":"a5cfaaf7-7534-408a-bed0-94d7a658538c","Type":"ContainerDied","Data":"c2e2eb5fbfc852955c450d3391bba4f044cace40b16a3fca851c3ffbfdb81afa"}
Jul 19 14:48:43.603071 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.603041    2582 scope.go:117] "RemoveContainer" containerID="5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"
Jul 19 14:48:43.620729 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.620709    2582 scope.go:117] "RemoveContainer" containerID="c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"
Jul 19 14:48:43.627912 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.627891    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:48:43.628553 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.628538    2582 scope.go:117] "RemoveContainer" containerID="5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"
Jul 19 14:48:43.628808 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:48:43.628792    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33\": container with ID starting with 5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33 not found: ID does not exist" containerID="5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"
Jul 19 14:48:43.628860 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.628815    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33"} err="failed to get container status \"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33\": rpc error: code = NotFound desc = could not find container \"5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33\": container with ID starting with 5897de692161bd44cd4524aecaf71831e73c5c437dca914fe6d2b06252748d33 not found: ID does not exist"
Jul 19 14:48:43.628860 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.628830    2582 scope.go:117] "RemoveContainer" containerID="c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"
Jul 19 14:48:43.629071 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:48:43.629053    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd\": container with ID starting with c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd not found: ID does not exist" containerID="c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"
Jul 19 14:48:43.629119 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.629078    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd"} err="failed to get container status \"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd\": rpc error: code = NotFound desc = could not find container \"c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd\": container with ID starting with c9b4426125aef58254ad922d94a7a84025584ab762e30077f21c649f714860dd not found: ID does not exist"
Jul 19 14:48:43.632041 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:43.631991    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a96ad8-openshift-default-64c6b4b557-7ths4"]
Jul 19 14:48:45.247506 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:45.247473    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" path="/var/lib/kubelet/pods/a5cfaaf7-7534-408a-bed0-94d7a658538c/volumes"
Jul 19 14:48:46.791709 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.791660    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:48:46.792245 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792229    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.792341 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792248    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.792341 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792265    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.792341 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792273    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.792434 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792369    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.792434 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.792381    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5cfaaf7-7534-408a-bed0-94d7a658538c" containerName="istio-proxy"
Jul 19 14:48:46.797150 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.797130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.799297 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.799279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4b4917-openshift-default-dockercfg-ntmvm\""
Jul 19 14:48:46.809619 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.809592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:48:46.911032 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr52l\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911171 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911171 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911171 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911171 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911384 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911384 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911384 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:46.911519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:46.911408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr52l\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012579 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.012984 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.012920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.013061 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.013009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.013241 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.013223    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.013308 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.013221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.014726 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.014706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.014938 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.014921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.021426 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.021401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.021839 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.021822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr52l\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l\") pod \"e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") " pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.107101 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.107041    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:47.301486 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.301463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:48:47.303119 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:48:47.303081    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd1d06f_d594_4cd0_aac5_1354501f6d0d.slice/crio-b5cb84c2ab47fcb27d616d72c982e8d1d079eed1ec1680d385b886ab699068d1 WatchSource:0}: Error finding container b5cb84c2ab47fcb27d616d72c982e8d1d079eed1ec1680d385b886ab699068d1: Status 404 returned error can't find the container with id b5cb84c2ab47fcb27d616d72c982e8d1d079eed1ec1680d385b886ab699068d1
Jul 19 14:48:47.305222 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.305186    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:47.305308 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.305251    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:47.305308 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.305279    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:47.624567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.624481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerStarted","Data":"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"}
Jul 19 14:48:47.624567 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.624549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerStarted","Data":"b5cb84c2ab47fcb27d616d72c982e8d1d079eed1ec1680d385b886ab699068d1"}
Jul 19 14:48:47.645053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:47.643990    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podStartSLOduration=1.643971453 podStartE2EDuration="1.643971453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:48:47.641247833 +0000 UTC m=+2160.924906280" watchObservedRunningTime="2026-07-19 14:48:47.643971453 +0000 UTC m=+2160.927629899"
Jul 19 14:48:48.108010 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:48.107975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:48.113217 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:48.113191    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:48.632100 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:48.632063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:48.633735 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:48.633499    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:48:52.653445 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.653419    2582 generic.go:356] "Generic (PLEG): container finished" podID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerID="2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78" exitCode=0
Jul 19 14:48:52.653800 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.653491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerDied","Data":"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"}
Jul 19 14:48:52.653843 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.653815    2582 scope.go:117] "RemoveContainer" containerID="2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"
Jul 19 14:48:52.654740 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.654715    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:52.654845 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.654774    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:52.654845 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:52.654804    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:48:53.660843 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:53.660814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerStarted","Data":"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"}
Jul 19 14:48:54.267716 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:54.267684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:54.268542 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:54.268522    2582 patch_prober.go:28] interesting pod/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 19 14:48:54.268640 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:54.268562    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 19 14:48:55.268441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:55.268404    2582 patch_prober.go:28] interesting pod/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 19 14:48:55.268856 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:55.268456    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 19 14:48:55.588735 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:55.588638    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:56.268437 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:56.268388    2582 patch_prober.go:28] interesting pod/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 19 14:48:56.268955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:56.268472    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 19 14:48:57.268287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:57.268253    2582 patch_prober.go:28] interesting pod/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 19 14:48:57.268476 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:57.268358    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 19 14:48:58.271974 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:58.271944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:48:58.272879 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:48:58.272861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:49:03.633370 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.633337    2582 patch_prober.go:28] interesting pod/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 19 14:49:03.633817 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.633393    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 19 14:49:03.716126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.716100    2582 generic.go:356] "Generic (PLEG): container finished" podID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerID="eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011" exitCode=0
Jul 19 14:49:03.716238 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.716130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerDied","Data":"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"}
Jul 19 14:49:03.716496 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.716478    2582 scope.go:117] "RemoveContainer" containerID="eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"
Jul 19 14:49:03.717360 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.717335    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:03.717411 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.717396    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:03.717447 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:03.717427    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:04.723403 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:04.723369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerStarted","Data":"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"}
Jul 19 14:49:05.107887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:05.107809    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:49:05.108053 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:05.107999    2582 patch_prober.go:28] interesting pod/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 19 14:49:05.108126 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:05.108062    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 19 14:49:06.107534 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:06.107499    2582 patch_prober.go:28] interesting pod/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 19 14:49:06.107914 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:06.107560    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 19 14:49:07.108086 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:07.108053    2582 patch_prober.go:28] interesting pod/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 19 14:49:07.108447 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:07.108103    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 19 14:49:08.107806 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:08.107772    2582 patch_prober.go:28] interesting pod/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 19 14:49:08.107999 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:08.107831    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 19 14:49:09.111725 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:09.111694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:49:09.112185 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:09.112071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:49:09.112767 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:09.112747    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:49:28.341287 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:28.341246    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:49:28.341882 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:28.341471    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy" containerID="cri-o://4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d" gracePeriod=30
Jul 19 14:49:33.588725 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.588699    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:49:33.753109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753068    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753109 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753155    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753180    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753195    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753244    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts4dn\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753349 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753306    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753640 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753366    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs\") pod \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\" (UID: \"05723aa0-2527-49cd-8a29-e1bf6b5c0876\") "
Jul 19 14:49:33.753640 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753510    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:49:33.753778 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:49:33.753925 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753882    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:49:33.753925 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.753892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:49:33.754082 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.754015    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.754082 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.754033    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.754082 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.754048    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.754082 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.754063    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.754436 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.754411    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data" (OuterVolumeSpecName: "istio-data") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:49:33.755469 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.755434    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:49:33.755750 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.755719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:49:33.755850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.755764    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn" (OuterVolumeSpecName: "kube-api-access-ts4dn") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "kube-api-access-ts4dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:49:33.755850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.755788    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token" (OuterVolumeSpecName: "istio-token") pod "05723aa0-2527-49cd-8a29-e1bf6b5c0876" (UID: "05723aa0-2527-49cd-8a29-e1bf6b5c0876"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:49:33.854784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.854757    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.854784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.854780    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts4dn\" (UniqueName: \"kubernetes.io/projected/05723aa0-2527-49cd-8a29-e1bf6b5c0876-kube-api-access-ts4dn\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.854784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.854789    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.854973 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.854798    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.854973 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.854805    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05723aa0-2527-49cd-8a29-e1bf6b5c0876-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:49:33.872135 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.872106    2582 generic.go:356] "Generic (PLEG): container finished" podID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerID="4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d" exitCode=0
Jul 19 14:49:33.872252 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.872149    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"
Jul 19 14:49:33.872252 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.872189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerDied","Data":"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"}
Jul 19 14:49:33.872252 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.872240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6" event={"ID":"05723aa0-2527-49cd-8a29-e1bf6b5c0876","Type":"ContainerDied","Data":"a3f36572a7501da17b002fc23a9ad847b036620e279122df9b5423619dd7f288"}
Jul 19 14:49:33.872377 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.872263    2582 scope.go:117] "RemoveContainer" containerID="4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"
Jul 19 14:49:33.881414 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.881397    2582 scope.go:117] "RemoveContainer" containerID="2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"
Jul 19 14:49:33.888952 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.888937    2582 scope.go:117] "RemoveContainer" containerID="4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"
Jul 19 14:49:33.889187 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:49:33.889170    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d\": container with ID starting with 4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d not found: ID does not exist" containerID="4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"
Jul 19 14:49:33.889257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.889198    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d"} err="failed to get container status \"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d\": rpc error: code = NotFound desc = could not find container \"4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d\": container with ID starting with 4ef1d84df5ce489dadc730a8e42fedbafb0dd17bb06cd8201e5685835d2c0e7d not found: ID does not exist"
Jul 19 14:49:33.889257 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.889223    2582 scope.go:117] "RemoveContainer" containerID="2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"
Jul 19 14:49:33.889463 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:49:33.889446    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78\": container with ID starting with 2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78 not found: ID does not exist" containerID="2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"
Jul 19 14:49:33.889501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.889469    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78"} err="failed to get container status \"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78\": rpc error: code = NotFound desc = could not find container \"2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78\": container with ID starting with 2996075dd4a6bf2cb9a4f748c223bc74e43674e6c62a82a4a80503f6a6727d78 not found: ID does not exist"
Jul 19 14:49:33.894235 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.894213    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:49:33.897650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:33.897631    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8e7a06-openshift-default-55bc7985d9-glsb6"]
Jul 19 14:49:35.247520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:35.247490    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" path="/var/lib/kubelet/pods/05723aa0-2527-49cd-8a29-e1bf6b5c0876/volumes"
Jul 19 14:49:55.314200 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:55.314158    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:49:55.314652 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:55.314350    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy" containerID="cri-o://9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345" gracePeriod=30
Jul 19 14:49:56.200753 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.200719    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:49:56.201116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.201093    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:49:56.201116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.201116    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:49:56.201291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.201144    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:49:56.201291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.201153    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:49:56.201291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.201258    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:49:56.204422 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.204403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.206611 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.206591    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3caf77-openshift-default-dockercfg-wcp82\""
Jul 19 14:49:56.215513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.215494    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:49:56.226557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226836 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226937 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226937 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9dc4\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.226937 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.226929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327325 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9dc4\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.327659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.328179 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.328179 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.328179 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.327969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.328357 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.328324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.328357 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.328335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.329792 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.329773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.330097 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.330078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.334367 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.334340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.334530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.334514    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9dc4\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4\") pod \"e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") " pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.515028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.514948    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:56.644063 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.644042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:49:56.645578 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:49:56.645554    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e34c063_64e4_4c49_9c5c_cc114ff7f16b.slice/crio-c53c9f1645a55f0ff65b00b10a1df94f8c598af2e0864d3a9e5c49c5423406ea WatchSource:0}: Error finding container c53c9f1645a55f0ff65b00b10a1df94f8c598af2e0864d3a9e5c49c5423406ea: Status 404 returned error can't find the container with id c53c9f1645a55f0ff65b00b10a1df94f8c598af2e0864d3a9e5c49c5423406ea
Jul 19 14:49:56.647773 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.647741    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:56.647881 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.647817    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:56.647945 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.647880    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:49:56.978678 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.978642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerStarted","Data":"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"}
Jul 19 14:49:56.978855 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.978706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerStarted","Data":"c53c9f1645a55f0ff65b00b10a1df94f8c598af2e0864d3a9e5c49c5423406ea"}
Jul 19 14:49:56.999808 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:56.999754    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podStartSLOduration=0.9997394 podStartE2EDuration="999.7394ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:49:56.998190249 +0000 UTC m=+2230.281848695" watchObservedRunningTime="2026-07-19 14:49:56.9997394 +0000 UTC m=+2230.283397843"
Jul 19 14:49:57.515438 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:57.515408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:57.519889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:57.519865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:57.984519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:57.984481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:49:57.985333 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:49:57.985315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:50:00.580225 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.580169    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:50:00.664659 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664787 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664764    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664947 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664866    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664947 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:50:00.664947 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664903    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr52l\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.664947 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.665151 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664953    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.665151 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.664973    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket\") pod \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\" (UID: \"fbd1d06f-d594-4cd0-aac5-1354501f6d0d\") "
Jul 19 14:50:00.665290 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.665265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:50:00.665347 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.665325    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.665401 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.665375    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:50:00.665548 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.665530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:50:00.665702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.665678    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:50:00.667030 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.667002    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:50:00.667127 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.667054    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:50:00.667215 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.667198    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:50:00.667291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.667269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l" (OuterVolumeSpecName: "kube-api-access-xr52l") pod "fbd1d06f-d594-4cd0-aac5-1354501f6d0d" (UID: "fbd1d06f-d594-4cd0-aac5-1354501f6d0d"). InnerVolumeSpecName "kube-api-access-xr52l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:50:00.766370 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766349    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766370 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766369    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766378    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr52l\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-kube-api-access-xr52l\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766387    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766395    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766402    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766410    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:00.766501 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:00.766417    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbd1d06f-d594-4cd0-aac5-1354501f6d0d-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:50:01.000575 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.000550    2582 generic.go:356] "Generic (PLEG): container finished" podID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerID="9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345" exitCode=0
Jul 19 14:50:01.000722 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.000596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"
Jul 19 14:50:01.000722 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.000635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerDied","Data":"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"}
Jul 19 14:50:01.000722 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.000713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s" event={"ID":"fbd1d06f-d594-4cd0-aac5-1354501f6d0d","Type":"ContainerDied","Data":"b5cb84c2ab47fcb27d616d72c982e8d1d079eed1ec1680d385b886ab699068d1"}
Jul 19 14:50:01.001087 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.000735    2582 scope.go:117] "RemoveContainer" containerID="9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"
Jul 19 14:50:01.009291 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.009277    2582 scope.go:117] "RemoveContainer" containerID="eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"
Jul 19 14:50:01.017487 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.017278    2582 scope.go:117] "RemoveContainer" containerID="9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"
Jul 19 14:50:01.019470 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:50:01.019372    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345\": container with ID starting with 9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345 not found: ID does not exist" containerID="9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"
Jul 19 14:50:01.019470 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.019407    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345"} err="failed to get container status \"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345\": rpc error: code = NotFound desc = could not find container \"9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345\": container with ID starting with 9a761f9ecf7cce7f8648eb9b31180190a2d84b6728d41d74ee5bd99ed6500345 not found: ID does not exist"
Jul 19 14:50:01.019470 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.019449    2582 scope.go:117] "RemoveContainer" containerID="eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"
Jul 19 14:50:01.020013 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:50:01.019992    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011\": container with ID starting with eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011 not found: ID does not exist" containerID="eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"
Jul 19 14:50:01.020083 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.020018    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011"} err="failed to get container status \"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011\": rpc error: code = NotFound desc = could not find container \"eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011\": container with ID starting with eb52840587bf164d682dfc80efdc1a23b261d4443360f091f564a4587814d011 not found: ID does not exist"
Jul 19 14:50:01.020907 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.020890    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:50:01.024266 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.024247    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4b4917-openshift-default-68d65f9847-zhq8s"]
Jul 19 14:50:01.246323 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:01.246300    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" path="/var/lib/kubelet/pods/fbd1d06f-d594-4cd0-aac5-1354501f6d0d/volumes"
Jul 19 14:50:04.000089 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.000057    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:50:04.000458 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.000408    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:50:04.000458 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.000421    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:50:04.000530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.000494    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:50:04.000530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.000505    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="05723aa0-2527-49cd-8a29-e1bf6b5c0876" containerName="istio-proxy"
Jul 19 14:50:04.005079 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.005058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.007226 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.007206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-adad07-openshift-default-dockercfg-xf6j2\""
Jul 19 14:50:04.014919 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.014895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:50:04.092018 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.091989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092139 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092239 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092239 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97q7\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092359 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092467 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.092598 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.092544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193424 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f97q7\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193424 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193994 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.193994 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.193970    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.194078 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.194028    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.194127 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.194102    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.194127 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.194116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.194351 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.194332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.195754 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.195734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.196031 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.196015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.200352 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.200324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97q7\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.200472 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.200418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token\") pod \"e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") " pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.316347 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.316280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:04.451557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.451524    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:50:04.456048 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:50:04.456022    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa1e592_167f_4c4d_8f68_1ffb9cae02f8.slice/crio-b0325287e2f378a7e01bfc16e743844da83ebce628176a288a361de9dfacee4c WatchSource:0}: Error finding container b0325287e2f378a7e01bfc16e743844da83ebce628176a288a361de9dfacee4c: Status 404 returned error can't find the container with id b0325287e2f378a7e01bfc16e743844da83ebce628176a288a361de9dfacee4c
Jul 19 14:50:04.458206 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.458179    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:04.458283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.458254    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:04.458332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:04.458283    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:05.021650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:05.021611    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerStarted","Data":"c75f450661cf0709d2223b4c3913a51cadbb7a2d1eaff58573fe51d291456c83"}
Jul 19 14:50:05.022117 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:05.021685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerStarted","Data":"b0325287e2f378a7e01bfc16e743844da83ebce628176a288a361de9dfacee4c"}
Jul 19 14:50:05.039161 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:05.039111    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podStartSLOduration=2.03909632 podStartE2EDuration="2.03909632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:50:05.037900131 +0000 UTC m=+2238.321558576" watchObservedRunningTime="2026-07-19 14:50:05.03909632 +0000 UTC m=+2238.322754765"
Jul 19 14:50:05.317146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:05.317073    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:05.321697 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:05.321655    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:06.026283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:06.026242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:06.031388 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:06.031359    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:12.985863 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:12.985834    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 19 14:50:12.986208 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:12.985883    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 19 14:50:13.070584 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.070560    2582 generic.go:356] "Generic (PLEG): container finished" podID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerID="2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411" exitCode=0
Jul 19 14:50:13.070702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.070633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerDied","Data":"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"}
Jul 19 14:50:13.071033 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.071014    2582 scope.go:117] "RemoveContainer" containerID="2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"
Jul 19 14:50:13.071942 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.071913    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:13.072018 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.072008    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:13.072055 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:13.072037    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:14.080213 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:14.080168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerStarted","Data":"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"}
Jul 19 14:50:14.515832 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:14.515796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:50:14.516003 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:14.515956    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 19 14:50:14.516047 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:14.516005    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 19 14:50:15.516161 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:15.516125    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 19 14:50:15.516530 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:15.516175    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 19 14:50:16.516234 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:16.516198    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 19 14:50:16.516622 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:16.516253    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 19 14:50:17.515839 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:17.515804    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 19 14:50:17.516014 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:17.515875    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 19 14:50:18.519600 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:18.519570    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:50:18.520017 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:18.519945    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:50:18.520636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:18.520616    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:50:21.027988 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.027956    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 19 14:50:21.028381 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.028005    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 19 14:50:21.116725 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.116697    2582 generic.go:356] "Generic (PLEG): container finished" podID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerID="c75f450661cf0709d2223b4c3913a51cadbb7a2d1eaff58573fe51d291456c83" exitCode=0
Jul 19 14:50:21.116902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.116782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerDied","Data":"c75f450661cf0709d2223b4c3913a51cadbb7a2d1eaff58573fe51d291456c83"}
Jul 19 14:50:21.117226 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.117209    2582 scope.go:117] "RemoveContainer" containerID="c75f450661cf0709d2223b4c3913a51cadbb7a2d1eaff58573fe51d291456c83"
Jul 19 14:50:21.118259 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.118230    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:21.118407 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.118381    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:21.118497 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:21.118455    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 19 14:50:22.129698 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:22.128415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerStarted","Data":"4faba224f73f76455673931ee6a0ce24f393071f22238b869f807e6c2d4ee838"}
Jul 19 14:50:22.317005 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:22.316971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:22.317168 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:22.317128    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 19 14:50:22.317211 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:22.317171    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 19 14:50:23.317590 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:23.317557    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 19 14:50:23.317970 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:23.317603    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 19 14:50:24.317560 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:24.317522    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 19 14:50:24.317766 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:24.317576    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 19 14:50:25.316940 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:25.316902    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 19 14:50:25.317136 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:25.316959    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 19 14:50:26.321850 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:26.321820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:26.322212 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:26.322095    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:50:26.322679 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:50:26.322644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:52:47.359266 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:52:47.359238    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:52:47.368528 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:52:47.368507    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:54:15.204712 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.204679    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:54:15.205118 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.205022    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:54:15.205118 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.205033    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:54:15.205118 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.205105    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd1d06f-d594-4cd0-aac5-1354501f6d0d" containerName="istio-proxy"
Jul 19 14:54:15.208029 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.208012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.209996 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.209974    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"rate-test-model-3caf77-kserve-self-signed-certs\""
Jul 19 14:54:15.210889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.210826    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"default-dockercfg-89zn5\""
Jul 19 14:54:15.210889 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.210875    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"openshift-service-ca.crt\""
Jul 19 14:54:15.211412 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.210920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"kube-root-ca.crt\""
Jul 19 14:54:15.218790 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.218765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:54:15.390074 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.390273 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.390273 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.390273 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcqrn\" (UniqueName: \"kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.390273 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.390408 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.390281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.490815 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.490815 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491022 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.490887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcqrn\" (UniqueName: \"kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491239 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.491176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491290 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.491236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.491290 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.491276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.492946 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.492923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.493157 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.493136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.497592 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.497573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcqrn\" (UniqueName: \"kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn\") pod \"rate-test-model-3caf77-kserve-5f959d8479-zvx8z\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") " pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.518575 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.518556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:15.650548 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:15.650517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:54:15.652940 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:54:15.652898    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48829701_7a37_4070_800a_e6b3d4c526d1.slice/crio-4bdb0e26f933eb63daa55bb4807a5df49fc5d7ceacfdd58ed3fc6e860e5f09e1 WatchSource:0}: Error finding container 4bdb0e26f933eb63daa55bb4807a5df49fc5d7ceacfdd58ed3fc6e860e5f09e1: Status 404 returned error can't find the container with id 4bdb0e26f933eb63daa55bb4807a5df49fc5d7ceacfdd58ed3fc6e860e5f09e1
Jul 19 14:54:16.236058 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:16.236023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" event={"ID":"48829701-7a37-4070-800a-e6b3d4c526d1","Type":"ContainerStarted","Data":"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"}
Jul 19 14:54:16.236441 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:16.236068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" event={"ID":"48829701-7a37-4070-800a-e6b3d4c526d1","Type":"ContainerStarted","Data":"4bdb0e26f933eb63daa55bb4807a5df49fc5d7ceacfdd58ed3fc6e860e5f09e1"}
Jul 19 14:54:16.252426 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:16.252375    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" podStartSLOduration=1.2523617360000001 podStartE2EDuration="1.252361736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:54:16.250404129 +0000 UTC m=+2489.534062586" watchObservedRunningTime="2026-07-19 14:54:16.252361736 +0000 UTC m=+2489.536020181"
Jul 19 14:54:25.519519 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:25.519486    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:25.520080 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:25.519530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:25.531797 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:25.531773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:54:26.293569 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:54:26.293541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:55:18.284054 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:18.284020    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:55:33.304289 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.304227    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" podUID="48829701-7a37-4070-800a-e6b3d4c526d1" containerName="main" containerID="cri-o://bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3" gracePeriod=45
Jul 19 14:55:33.568956 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.568898    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:55:33.599043 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.599011    2582 generic.go:356] "Generic (PLEG): container finished" podID="48829701-7a37-4070-800a-e6b3d4c526d1" containerID="bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3" exitCode=0
Jul 19 14:55:33.599162 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.599059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" event={"ID":"48829701-7a37-4070-800a-e6b3d4c526d1","Type":"ContainerDied","Data":"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"}
Jul 19 14:55:33.599162 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.599066    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"
Jul 19 14:55:33.599162 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.599094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z" event={"ID":"48829701-7a37-4070-800a-e6b3d4c526d1","Type":"ContainerDied","Data":"4bdb0e26f933eb63daa55bb4807a5df49fc5d7ceacfdd58ed3fc6e860e5f09e1"}
Jul 19 14:55:33.599162 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.599112    2582 scope.go:117] "RemoveContainer" containerID="bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"
Jul 19 14:55:33.607563 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.607544    2582 scope.go:117] "RemoveContainer" containerID="bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"
Jul 19 14:55:33.607860 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:55:33.607840    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3\": container with ID starting with bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3 not found: ID does not exist" containerID="bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"
Jul 19 14:55:33.607940 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.607873    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3"} err="failed to get container status \"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3\": rpc error: code = NotFound desc = could not find container \"bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3\": container with ID starting with bcff9d0192cdeed4bf1f483b1f5d76318e8f6a5257dc9dfebdae0513dcce46e3 not found: ID does not exist"
Jul 19 14:55:33.685516 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685487    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcqrn\" (UniqueName: \"kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.685730 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.685730 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685581    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.685730 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685635    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.685730 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.685955 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685752    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache\") pod \"48829701-7a37-4070-800a-e6b3d4c526d1\" (UID: \"48829701-7a37-4070-800a-e6b3d4c526d1\") "
Jul 19 14:55:33.686023 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.685996    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home" (OuterVolumeSpecName: "home") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:33.686077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.686025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:33.686077 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.686038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:33.686169 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.686086    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-home\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.687882 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.687856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn" (OuterVolumeSpecName: "kube-api-access-lcqrn") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "kube-api-access-lcqrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:55:33.687966 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.687900    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:55:33.688319 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.688300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm" (OuterVolumeSpecName: "dshm") pod "48829701-7a37-4070-800a-e6b3d4c526d1" (UID: "48829701-7a37-4070-800a-e6b3d4c526d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:33.786513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.786480    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48829701-7a37-4070-800a-e6b3d4c526d1-tls-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.786513 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.786508    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-dshm\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.786736 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.786543    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-tmp-dir\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.786736 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.786554    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48829701-7a37-4070-800a-e6b3d4c526d1-model-cache\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.786736 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.786566    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcqrn\" (UniqueName: \"kubernetes.io/projected/48829701-7a37-4070-800a-e6b3d4c526d1-kube-api-access-lcqrn\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:55:33.921732 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.921704    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:55:33.925845 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:33.925814    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/rate-test-model-3caf77-kserve-5f959d8479-zvx8z"]
Jul 19 14:55:35.254801 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:55:35.254765    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48829701-7a37-4070-800a-e6b3d4c526d1" path="/var/lib/kubelet/pods/48829701-7a37-4070-800a-e6b3d4c526d1/volumes"
Jul 19 14:56:00.479777 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:00.479744    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:56:00.480246 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:00.479972    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" containerID="cri-o://2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5" gracePeriod=30
Jul 19 14:56:03.522617 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:03.522569    2582 patch_prober.go:28] interesting pod/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 14:56:03.523001 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:03.522629    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:56:05.740702 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.740678    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:56:05.762654 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.762580    2582 generic.go:356] "Generic (PLEG): container finished" podID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerID="2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5" exitCode=0
Jul 19 14:56:05.762654 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.762626    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"
Jul 19 14:56:05.762819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.762658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerDied","Data":"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"}
Jul 19 14:56:05.762819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.762732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j" event={"ID":"8e34c063-64e4-4c49-9c5c-cc114ff7f16b","Type":"ContainerDied","Data":"c53c9f1645a55f0ff65b00b10a1df94f8c598af2e0864d3a9e5c49c5423406ea"}
Jul 19 14:56:05.762819 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.762772    2582 scope.go:117] "RemoveContainer" containerID="2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"
Jul 19 14:56:05.773389 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.773370    2582 scope.go:117] "RemoveContainer" containerID="2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"
Jul 19 14:56:05.776776 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.776757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.776887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.776812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.776887 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.776830    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777012 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.776929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777012 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.776976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9dc4\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777124 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777026    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777124 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777094    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777233 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777233 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo\") pod \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\" (UID: \"8e34c063-64e4-4c49-9c5c-cc114ff7f16b\") "
Jul 19 14:56:05.777233 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:56:05.777468 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777446    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:05.777650 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777609    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:05.777784 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:05.777901 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777550    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.777901 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.777703    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:05.779366 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.779339    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:56:05.779653 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.779623    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:05.779801 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.779769    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:56:05.780636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.780607    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4" (OuterVolumeSpecName: "kube-api-access-m9dc4") pod "8e34c063-64e4-4c49-9c5c-cc114ff7f16b" (UID: "8e34c063-64e4-4c49-9c5c-cc114ff7f16b"). InnerVolumeSpecName "kube-api-access-m9dc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:56:05.784428 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.784391    2582 scope.go:117] "RemoveContainer" containerID="2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"
Jul 19 14:56:05.784724 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:56:05.784706    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5\": container with ID starting with 2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5 not found: ID does not exist" containerID="2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"
Jul 19 14:56:05.784776 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.784731    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5"} err="failed to get container status \"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5\": rpc error: code = NotFound desc = could not find container \"2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5\": container with ID starting with 2296957fd7e795da6cfb9c1e8ff06c87ce31b2c7c2aebe6159f085088ebdc8c5 not found: ID does not exist"
Jul 19 14:56:05.784776 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.784750    2582 scope.go:117] "RemoveContainer" containerID="2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"
Jul 19 14:56:05.785043 ip-10-0-141-191 kubenswrapper[2582]: E0719 14:56:05.785011    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411\": container with ID starting with 2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411 not found: ID does not exist" containerID="2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"
Jul 19 14:56:05.785120 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.785052    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411"} err="failed to get container status \"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411\": rpc error: code = NotFound desc = could not find container \"2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411\": container with ID starting with 2129de7c0ad470677c932fa9e712ee64413a32080436263f32c745341669a411 not found: ID does not exist"
Jul 19 14:56:05.878798 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878764    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.878798 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878793    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.878798 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878804    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9dc4\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-kube-api-access-m9dc4\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.879028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878813    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.879028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878821    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.879028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878829    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.879028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878838    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:05.879028 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:05.878846    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e34c063-64e4-4c49-9c5c-cc114ff7f16b-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:06.093916 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:06.093884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:56:06.099399 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:06.099372    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3caf77-openshift-default-dbcf65899-cwr5j"]
Jul 19 14:56:07.247654 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:07.247616    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" path="/var/lib/kubelet/pods/8e34c063-64e4-4c49-9c5c-cc114ff7f16b/volumes"
Jul 19 14:56:23.731910 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:23.731826    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:56:23.732424 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:23.732034    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" containerID="cri-o://4faba224f73f76455673931ee6a0ce24f393071f22238b869f807e6c2d4ee838" gracePeriod=30
Jul 19 14:56:24.462173 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:24.462133    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f785b9cf-b9j5d_7ff2f89f-a21d-49b7-86da-68eab53fd68d/authorino/0.log"
Jul 19 14:56:26.324941 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:26.324900    2582 patch_prober.go:28] interesting pod/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 14:56:26.325336 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:26.324972    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:56:28.879654 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:28.879605    2582 generic.go:356] "Generic (PLEG): container finished" podID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerID="4faba224f73f76455673931ee6a0ce24f393071f22238b869f807e6c2d4ee838" exitCode=0
Jul 19 14:56:28.880122 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:28.879783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerDied","Data":"4faba224f73f76455673931ee6a0ce24f393071f22238b869f807e6c2d4ee838"}
Jul 19 14:56:28.880122 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:28.879847    2582 scope.go:117] "RemoveContainer" containerID="c75f450661cf0709d2223b4c3913a51cadbb7a2d1eaff58573fe51d291456c83"
Jul 19 14:56:28.996049 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:28.995984    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:56:29.104125 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104125 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104129    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f97q7\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104190    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104284    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104383 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104337    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104431    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket\") pod \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\" (UID: \"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8\") "
Jul 19 14:56:29.104643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:29.104643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104559    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:29.104643 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:56:29.104917 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:29.104917 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104857    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istiod-ca-cert\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.104917 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104875    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-certs\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.104917 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.104891    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-workload-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.105557 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.105532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:29.106610 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.106584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 19 14:56:29.106757 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.106623    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:56:29.106951 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.106921    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:56:29.107043 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.106952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7" (OuterVolumeSpecName: "kube-api-access-f97q7") pod "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" (UID: "6aa1e592-167f-4c4d-8f68-1ffb9cae02f8"). InnerVolumeSpecName "kube-api-access-f97q7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:56:29.205642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205590    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f97q7\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-kube-api-access-f97q7\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.205642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205636    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-envoy\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.205642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205647    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-token\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.205642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205655    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-data\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.205642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205688    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-istio-podinfo\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.205988 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.205697    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8-credential-socket\") on node \"ip-10-0-141-191.ec2.internal\" DevicePath \"\""
Jul 19 14:56:29.885875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.885841    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"
Jul 19 14:56:29.885875 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.885850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2" event={"ID":"6aa1e592-167f-4c4d-8f68-1ffb9cae02f8","Type":"ContainerDied","Data":"b0325287e2f378a7e01bfc16e743844da83ebce628176a288a361de9dfacee4c"}
Jul 19 14:56:29.886377 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.885914    2582 scope.go:117] "RemoveContainer" containerID="4faba224f73f76455673931ee6a0ce24f393071f22238b869f807e6c2d4ee838"
Jul 19 14:56:29.910858 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.910830    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:56:29.922093 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:29.922062    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-adad07-openshift-default-7444f9fb55-kbsb2"]
Jul 19 14:56:30.151725 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:30.151623    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6jjxp_0f60751a-fa7f-4eaf-9bf3-d063865ffe1d/manager/0.log"
Jul 19 14:56:31.013730 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:31.013700    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-67dvm_83f5fddf-048e-4d91-9837-4bf775eee3e6/copy-manifests/0.log"
Jul 19 14:56:31.030507 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:31.030476    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-67dvm_83f5fddf-048e-4d91-9837-4bf775eee3e6/manager/0.log"
Jul 19 14:56:31.247514 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:31.247479    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" path="/var/lib/kubelet/pods/6aa1e592-167f-4c4d-8f68-1ffb9cae02f8/volumes"
Jul 19 14:56:33.353381 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:33.353353    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f785b9cf-b9j5d_7ff2f89f-a21d-49b7-86da-68eab53fd68d/authorino/0.log"
Jul 19 14:56:33.489152 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:33.489120    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wr6kn_5ca425b5-ff11-4093-a5f2-177037b89294/manager/0.log"
Jul 19 14:56:33.732738 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:33.732706    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c4h2q_c1c31309-2a93-427c-8268-f9beedc1d294/kuadrant-console-plugin/0.log"
Jul 19 14:56:34.659604 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:34.659575    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678c69wc_f49125ba-51d5-48c3-9bec-ab7adaf7965d/istio-proxy/0.log"
Jul 19 14:56:35.171686 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:35.171639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/1.log"
Jul 19 14:56:35.569607 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:35.569519    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7944cdf68-hkq2v_746525da-4951-4c57-9f42-3725407eeb15/router/0.log"
Jul 19 14:56:36.078487 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:36.078461    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dhc8q_0041f2d2-c912-4649-9188-5a6f11da4182/main/0.log"
Jul 19 14:56:36.483529 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:36.483499    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rhbl4_6044ce64-ae0f-4aad-99a3-137922885a3a/main/0.log"
Jul 19 14:56:46.374332 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:46.374297    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c7l6c_235f95e3-d77f-46f7-a93f-47e3f0836278/global-pull-secret-syncer/0.log"
Jul 19 14:56:47.173642 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:47.173610    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4mrfd_d214e9bb-e32b-4878-972b-7906c247e374/konnectivity-agent/0.log"
Jul 19 14:56:47.500038 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:47.499939    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-191.ec2.internal_cdb2a6ab87f995db98b4a51f49f0932c/haproxy/0.log"
Jul 19 14:56:52.173396 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:52.173358    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79f785b9cf-b9j5d_7ff2f89f-a21d-49b7-86da-68eab53fd68d/authorino/0.log"
Jul 19 14:56:52.240498 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:52.240468    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wr6kn_5ca425b5-ff11-4093-a5f2-177037b89294/manager/0.log"
Jul 19 14:56:52.384283 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:52.384252    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-c4h2q_c1c31309-2a93-427c-8268-f9beedc1d294/kuadrant-console-plugin/0.log"
Jul 19 14:56:54.972969 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:54.972935    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-pqtk7_76530044-a09f-46e4-9872-c0ff1cd72546/cluster-monitoring-operator/0.log"
Jul 19 14:56:55.246848 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.246769    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-m4kw7_350e097a-4691-4690-a00b-be46f4b61379/monitoring-plugin/0.log"
Jul 19 14:56:55.296151 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296115    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"]
Jul 19 14:56:55.296620 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296593    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296620 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296618    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296629    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296638    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296646    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48829701-7a37-4070-800a-e6b3d4c526d1" containerName="main"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296653    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="48829701-7a37-4070-800a-e6b3d4c526d1" containerName="main"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296681    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296690    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296703    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296714    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296799    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296811    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e34c063-64e4-4c49-9c5c-cc114ff7f16b" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296818    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296825    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa1e592-167f-4c4d-8f68-1ffb9cae02f8" containerName="istio-proxy"
Jul 19 14:56:55.296861 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.296831    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="48829701-7a37-4070-800a-e6b3d4c526d1" containerName="main"
Jul 19 14:56:55.298793 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.298771    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-427hq_c72efba9-33f6-4410-befd-ba0ee4409745/node-exporter/0.log"
Jul 19 14:56:55.301240 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.301224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.304692 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.304661    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7f9m7\"/\"default-dockercfg-zm26k\""
Jul 19 14:56:55.305007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.304991    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7f9m7\"/\"kube-root-ca.crt\""
Jul 19 14:56:55.305068 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.305005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7f9m7\"/\"openshift-service-ca.crt\""
Jul 19 14:56:55.325697 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.325655    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"]
Jul 19 14:56:55.365279 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.365248    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-427hq_c72efba9-33f6-4410-befd-ba0ee4409745/kube-rbac-proxy/0.log"
Jul 19 14:56:55.414915 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.414891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-427hq_c72efba9-33f6-4410-befd-ba0ee4409745/init-textfile/0.log"
Jul 19 14:56:55.447479 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.447446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md5tb\" (UniqueName: \"kubernetes.io/projected/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-kube-api-access-md5tb\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.447636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.447516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-proc\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.447636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.447533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-lib-modules\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.447636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.447558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-podres\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.447636 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.447574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-sys\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.548793 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.548692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-podres\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.548793 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.548745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-sys\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549001 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.548807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md5tb\" (UniqueName: \"kubernetes.io/projected/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-kube-api-access-md5tb\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549001 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.548859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-sys\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549001 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.548859    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-podres\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.549042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-proc\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549108 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.549065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-lib-modules\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549186 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.549147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-proc\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.549233 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.549190    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-lib-modules\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.566379 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.566350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md5tb\" (UniqueName: \"kubernetes.io/projected/f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd-kube-api-access-md5tb\") pod \"perf-node-gather-daemonset-rgm47\" (UID: \"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.610637 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.610608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:55.770890 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:55.770841    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"]
Jul 19 14:56:55.773698 ip-10-0-141-191 kubenswrapper[2582]: W0719 14:56:55.773654    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5b8b8fd_e37f_4ce8_9d02_15d203e1cbdd.slice/crio-33203d719945c1662e147fdd6416a04a1562025c48d9d2b213bffe0cd1467c64 WatchSource:0}: Error finding container 33203d719945c1662e147fdd6416a04a1562025c48d9d2b213bffe0cd1467c64: Status 404 returned error can't find the container with id 33203d719945c1662e147fdd6416a04a1562025c48d9d2b213bffe0cd1467c64
Jul 19 14:56:56.012134 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:56.012097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47" event={"ID":"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd","Type":"ContainerStarted","Data":"7e26353298d0a08b392a8b0683c798174c21de51555e3905105a680de8826826"}
Jul 19 14:56:56.012633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:56.012158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47" event={"ID":"f5b8b8fd-e37f-4ce8-9d02-15d203e1cbdd","Type":"ContainerStarted","Data":"33203d719945c1662e147fdd6416a04a1562025c48d9d2b213bffe0cd1467c64"}
Jul 19 14:56:56.012633 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:56.012216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:56:56.039154 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:56.035721    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47" podStartSLOduration=1.035700761 podStartE2EDuration="1.035700761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:56:56.033547883 +0000 UTC m=+2649.317206331" watchObservedRunningTime="2026-07-19 14:56:56.035700761 +0000 UTC m=+2649.319359207"
Jul 19 14:56:57.719606 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:57.719578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-r45l4_465147a2-7da3-4d2d-8000-40e07c15b1a2/networking-console-plugin/0.log"
Jul 19 14:56:58.236034 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:58.236006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/1.log"
Jul 19 14:56:58.240116 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:58.240078    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-t4k8d_0bbc111b-df64-40ae-a9f4-e670d3a280e9/console-operator/2.log"
Jul 19 14:56:59.387306 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:56:59.387275    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-r4nqf_206e76a1-cbcb-47f7-8260-bfd3ec2d3a31/volume-data-source-validator/0.log"
Jul 19 14:57:00.634420 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:00.634392    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vlgrp_aedaacdf-446f-4dda-8e99-44027d5f8322/dns/0.log"
Jul 19 14:57:00.657069 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:00.657044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vlgrp_aedaacdf-446f-4dda-8e99-44027d5f8322/kube-rbac-proxy/0.log"
Jul 19 14:57:00.711880 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:00.711852    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frw6w_7c133b6d-e8fb-415c-b652-2f5c0105b298/dns-node-resolver/0.log"
Jul 19 14:57:01.417302 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:01.417271    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nj6tn_7d3707c1-d4dc-4c14-8ba3-164704dbfc9e/node-ca/0.log"
Jul 19 14:57:02.026782 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:02.026753    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-rgm47"
Jul 19 14:57:02.408426 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:02.408379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678c69wc_f49125ba-51d5-48c3-9bec-ab7adaf7965d/istio-proxy/0.log"
Jul 19 14:57:02.622290 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:02.622259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/0.log"
Jul 19 14:57:02.646083 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:02.646056    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/1.log"
Jul 19 14:57:02.744645 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:02.744568    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7944cdf68-hkq2v_746525da-4951-4c57-9f42-3725407eeb15/router/0.log"
Jul 19 14:57:03.460122 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:03.460086    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2wlrr_26409d1e-6375-465b-9c92-afad2a8cfef0/serve-healthcheck-canary/0.log"
Jul 19 14:57:04.113803 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:04.113771    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-79qzm_4a7a8662-09de-4f65-80f7-f8cf29d56eab/insights-operator/0.log"
Jul 19 14:57:04.114520 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:04.114501    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-79qzm_4a7a8662-09de-4f65-80f7-f8cf29d56eab/insights-operator/1.log"
Jul 19 14:57:04.138007 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:04.137984    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfmhx_907d760a-7cde-4836-8b56-cf2451418276/kube-rbac-proxy/0.log"
Jul 19 14:57:04.161242 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:04.161169    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfmhx_907d760a-7cde-4836-8b56-cf2451418276/exporter/0.log"
Jul 19 14:57:04.183781 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:04.183740    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dfmhx_907d760a-7cde-4836-8b56-cf2451418276/extractor/0.log"
Jul 19 14:57:06.081949 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:06.081921    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678c69wc_f49125ba-51d5-48c3-9bec-ab7adaf7965d/istio-proxy/0.log"
Jul 19 14:57:06.293490 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:06.293457    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/0.log"
Jul 19 14:57:06.317554 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:06.317524    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/1.log"
Jul 19 14:57:06.410902 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:06.410879    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7944cdf68-hkq2v_746525da-4951-4c57-9f42-3725407eeb15/router/0.log"
Jul 19 14:57:06.873526 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:06.873482    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6jjxp_0f60751a-fa7f-4eaf-9bf3-d063865ffe1d/manager/0.log"
Jul 19 14:57:07.792090 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:07.792063    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678c69wc_f49125ba-51d5-48c3-9bec-ab7adaf7965d/istio-proxy/0.log"
Jul 19 14:57:07.953379 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:07.953347    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-67dvm_83f5fddf-048e-4d91-9837-4bf775eee3e6/manager/0.log"
Jul 19 14:57:08.045998 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:08.045922    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-67dvm_83f5fddf-048e-4d91-9837-4bf775eee3e6/copy-manifests/0.log"
Jul 19 14:57:08.092504 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:08.092458    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/0.log"
Jul 19 14:57:08.118258 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:08.118225    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-5njlh_3c29b5a8-fd19-4dd8-8ed1-882cdae2249f/istio-proxy/1.log"
Jul 19 14:57:08.224146 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:08.224122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7944cdf68-hkq2v_746525da-4951-4c57-9f42-3725407eeb15/router/0.log"
Jul 19 14:57:09.573584 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:09.573539    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d56c9879c-9lbgr_8ec37e7e-947c-425e-9019-2085f1e11520/manager/0.log"
Jul 19 14:57:09.682999 ip-10-0-141-191 kubenswrapper[2582]: I0719 14:57:09.682968    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8nvt9_986046f0-a9cf-4b0a-b9b4-88a3b2a1e482/openshift-lws-operator/0.log"