Jul 16 21:49:04.582856 ip-10-0-141-223 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 21:49:04.971001 ip-10-0-141-223 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:49:04.971001 ip-10-0-141-223 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 21:49:04.971001 ip-10-0-141-223 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:49:04.971001 ip-10-0-141-223 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 21:49:04.971001 ip-10-0-141-223 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:49:04.971723 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.971242    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 21:49:04.977609 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977593    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.977609 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977608    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977612    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977615    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977618    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977621    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977624    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977627    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977630    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977632    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977635    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977638    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977640    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977644    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977646    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977649    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977651    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977654    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977656    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977659    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977661    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.977676 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977664    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977682    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977685    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977688    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977691    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977694    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977696    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977699    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977701    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977703    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977706    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977709    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977711    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977716    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977720    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977723    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977725    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977728    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.978143 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977732    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977735    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977738    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977741    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977744    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977746    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977749    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977751    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977754    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977756    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977759    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977761    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977764    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977766    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977769    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977772    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977775    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977778    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977780    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977783    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.978619 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977787    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977791    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977794    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977797    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977799    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977802    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977805    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977808    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977810    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977813    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977815    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977818    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977821    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977823    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977826    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977828    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977831    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977833    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977835    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977839    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.979105 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977841    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977844    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977847    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977849    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977852    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977854    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977857    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977859    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977862    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977865    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977868    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977870    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977873    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977875    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977878    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977880    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977883    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977886    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977889    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.977891    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.979602 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978621    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978629    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978632    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978635    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978638    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978641    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978643    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978646    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978649    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978651    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978654    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978656    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978660    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978663    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978666    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978668    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978671    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978673    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978676    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978679    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.980090 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978681    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978684    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978686    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978688    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978691    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978693    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978696    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978699    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978701    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978704    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978706    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978709    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978713    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978717    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978720    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978723    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978726    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978729    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978732    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.980707 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978736    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978740    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978743    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978745    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978748    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978751    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978754    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978757    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978761    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978764    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978766    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978769    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978771    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978775    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978778    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978780    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978783    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978785    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978788    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978790    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.981172 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978793    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978795    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978798    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978800    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978802    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978805    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978807    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978810    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978812    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978815    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978817    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978819    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978823    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978827    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978829    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978832    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978834    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978837    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978840    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978843    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.981669 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978846    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978849    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978851    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978854    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978857    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978860    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978862    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978864    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978867    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978869    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978872    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978874    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978876    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978879    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978881    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978884    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978886    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978889    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978891    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.978893    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.982156 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979282    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979287    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979289    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979292    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979295    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979297    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979300    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979303    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979306    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979309    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979313    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979315    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979318    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979321    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979324    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979327    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979330    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979333    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979335    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.982662 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979338    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979340    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979343    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979345    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979348    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979350    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979353    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979356    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979358    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979361    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979363    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979366    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979369    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979371    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979374    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979376    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979379    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979381    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979383    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979386    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.983117 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979388    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979391    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979394    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979396    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979399    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979402    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979404    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979407    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979410    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979412    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979415    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979418    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979420    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979423    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979426    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979428    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979431    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979433    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979436    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979438    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.983618 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979440    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979443    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979445    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979447    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979450    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979452    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979455    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979457    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979459    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979462    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979466    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979469    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979472    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979475    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979482    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979484    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979487    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979489    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979492    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979494    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.984153 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979497    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979500    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979503    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979505    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979508    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979510    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979512    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979515    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979518    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979538    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979542    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979545    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979548    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979551    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979554    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979557    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979559    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979562    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979565    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.979568    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.984656 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979643    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979650    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979656    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979661    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979665    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979668    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979674    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979679    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979683    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979686    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979689    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979692    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979695    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979701    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979704    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979707    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979710    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979712    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979717    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979720    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979723    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979726    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979729    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979733    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 21:49:04.985171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979735    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979738    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979742    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979744    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979747    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979750    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979753    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979756    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979760    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979763    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979766    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979768    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979771    2568 flags.go:64] FLAG: --enable-server="true"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979774    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979780    2568 flags.go:64] FLAG: --event-burst="100"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979783    2568 flags.go:64] FLAG: --event-qps="50"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979786    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979789    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979792    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979796    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979799    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979803    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979807    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979809    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979812    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 21:49:04.985748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979815    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979818    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979821    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979824    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979826    2568 flags.go:64] FLAG: --feature-gates=""
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979832    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979835    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979838    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979842    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979845    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979848    2568 flags.go:64] FLAG: --help="false"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979850    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-141-223.ec2.internal"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979853    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979856    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979859    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979862    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979866    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979869    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979871    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979874    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979877    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979881    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979884    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979887    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 16 21:49:04.986356 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979889    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979892    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979895    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979898    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979903    2568 flags.go:64] FLAG: --lock-file=""
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979905    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979908    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979911    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979917    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979919    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979922    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979925    2568 flags.go:64] FLAG: --logging-format="text"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979928    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979931    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979934    2568 flags.go:64] FLAG: --manifest-url=""
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979936    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979941    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979943    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979947    2568 flags.go:64] FLAG: --max-pods="110"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979950    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979953    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979956    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979959    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979962    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979964    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 21:49:04.986976 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979967    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979974    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979977    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979980    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979984    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979986    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979992    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979995    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.979998    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980001    2568 flags.go:64] FLAG: --port="10250"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980004    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980008    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b86eabb1ca3df3cb"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980011    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980014    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980017    2568 flags.go:64] FLAG: --register-node="true"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980020    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980023    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980026    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980029    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980032    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980035    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980038    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980042    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980044    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980047    2568 flags.go:64] FLAG: --runonce="false"
Jul 16 21:49:04.987601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980050    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980053    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980056    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980058    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980061    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980064    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980067    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980071    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980073    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980076    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980079    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980081    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980085    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980088    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980091    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980107    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980110    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980113    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980119    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980121    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980124    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980127    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980130    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980133    2568 flags.go:64] FLAG: --v="2"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980137    2568 flags.go:64] FLAG: --version="false"
Jul 16 21:49:04.988210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980141    2568 flags.go:64] FLAG: --vmodule=""
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980145    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.980148    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980284    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980288    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980290    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980293    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980296    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980299    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980301    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980304    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980306    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980309    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980312    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980314    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980317    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980319    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980322    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980324    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.988869 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980329    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980331    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980334    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980336    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980339    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980342    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980344    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980347    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980349    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980353    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980357    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980361    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980364    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980367    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980369    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980372    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980374    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980376    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980379    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.989325 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980381    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980384    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980387    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980389    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980391    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980394    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980396    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980400    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980404    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980407    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980410    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980412    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980415    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980419    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980421    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980424    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980426    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980429    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980431    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980434    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.989824 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980436    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980439    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980441    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980444    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980447    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980450    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980453    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980455    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980458    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980460    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980463    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980465    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980467    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980470    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980472    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980475    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980477    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980480    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980482    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980484    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.990306 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980487    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980489    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980492    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980494    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980497    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980501    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980503    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980506    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980508    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980510    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980513    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980515    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980532    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980535    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980538    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980540    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980543    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980545    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980549    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980551    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.990803 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980554    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980556    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980559    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.980561    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.981162    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.988224    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.988244    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.988258    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.988265    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988322    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988327    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988330    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988334    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988337    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988340    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.991317 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988342    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988345    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988348    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988350    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988353    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988356    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988358    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988361    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988364    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988367    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988370    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988372    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988375    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988377    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988380    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988383    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988385    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988388    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988391    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.991761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988394    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988396    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988399    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988402    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988406    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988409    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988412    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988415    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988417    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988420    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988422    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988425    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988427    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988430    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988432    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988435    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988438    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988441    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988443    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988446    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988448    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.992232 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988451    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988453    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988456    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988459    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988461    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988464    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988466    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988469    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988472    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988474    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988477    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988479    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988482    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988484    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988488    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988490    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988493    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988496    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988498    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988501    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.992820 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988503    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988506    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988510    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988513    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988516    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988518    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988538    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988541    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988544    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988546    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988549    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988552    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988556    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988560    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988563    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988567    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988571    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988573    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988576    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.993308 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988579    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988582    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988584    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988587    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988589    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988592    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988594    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988597    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988601    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988603    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988606    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988609    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988612    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988614    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.988619    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:49:04.993792 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988737    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988742    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988745    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988748    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988752    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988757    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988760    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988763    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988766    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988768    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988771    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988774    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988778    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988782    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988785    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988788    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988790    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988793    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:49:04.994168 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988795    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988798    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988801    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988803    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988806    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988808    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988812    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988815    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988818    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988820    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988823    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988826    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988829    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988831    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988834    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988836    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988839    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988841    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988844    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988846    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:49:04.994608 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988849    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988851    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988854    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988856    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988859    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988861    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988864    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988866    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988869    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988871    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988874    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988877    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988879    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988882    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988885    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988887    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988890    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988892    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988895    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988898    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:49:04.995098 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988901    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988903    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988905    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988909    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988911    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988914    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988916    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988919    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988921    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988924    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988927    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988929    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988931    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988934    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988936    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988939    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988941    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988943    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988946    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988948    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:49:04.995600 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988951    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988953    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988956    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988959    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988963    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988966    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988968    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988971    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988974    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988977    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988979    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988982    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988985    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988987    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988990    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988992    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988995    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.988998    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.989000    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.989003    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:49:04.996108 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:04.989005    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.989010    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.989138    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.991227    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.992584    2568 server.go:1019] "Starting client certificate rotation"
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.992696    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.992737    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:49:04.996742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:04.995877    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:49:05.000174 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.000149    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:49:05.011744 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.011716    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 16 21:49:05.013817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.013801    2568 log.go:25] "Validated CRI v1 image API"
Jul 16 21:49:05.014582 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.014567    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 21:49:05.017303 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.017277    2568 fs.go:135] Filesystem UUIDs: map[207ae0e4-1d12-4301-9758-cfc31da23601:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d1d823dc-23d0-4c43-9292-15c656a8f721:/dev/nvme0n1p3]
Jul 16 21:49:05.017363 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.017303    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 21:49:05.022775 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.022583    2568 manager.go:216] Machine: {Timestamp:2026-07-16 21:49:05.021204478 +0000 UTC m=+0.325301836 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106783 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddc4f1854b84b894155b2e2d064a3 SystemUUID:ec2ddc4f-1854-b84b-8941-55b2e2d064a3 BootID:8b89a6dd-13ae-4213-ae30-5e0ff814d8de Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:f0:63:79:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:f0:63:79:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:20:f9:ea:94:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 21:49:05.022866 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.022775    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 21:49:05.022900 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.022878    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 21:49:05.025938 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.025906    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 21:49:05.026092 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.025940    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 21:49:05.026743 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.026732    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 21:49:05.026781 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.026746    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 21:49:05.026781 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.026753    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:49:05.027475 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.027464    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:49:05.028613 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.028603    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 21:49:05.032543 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032513    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:49:05.032675 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032665    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 21:49:05.032708 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032698    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 21:49:05.032708 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032708    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 21:49:05.032762 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032724    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 21:49:05.032762 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032733    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 16 21:49:05.032762 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.032742    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 21:49:05.033171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.033149    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:49:05.033171 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.033171    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:49:05.035605 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.035582    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:49:05.035707 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.035642    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 21:49:05.038070 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038049    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 21:49:05.038143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038100    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 21:49:05.038896 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038874    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038905    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038915    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038926    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038941    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038951    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038972    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038982    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.038995    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.039007    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.039023    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 21:49:05.039056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.039033    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 21:49:05.040598 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.040581    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 21:49:05.040647 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.040612    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 21:49:05.044134 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.044119    2568 server.go:1268] "Started kubelet"
Jul 16 21:49:05.044256 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.044222    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 21:49:05.044873 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.044372    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 21:49:05.044873 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.044467    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 21:49:05.045123 ip-10-0-141-223 systemd[1]: Started Kubernetes Kubelet.
Jul 16 21:49:05.045906 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.045888    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 21:49:05.046500 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.046481    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 21:49:05.046749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.046732    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 21:49:05.049347 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.049321    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 21:49:05.052792 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.052771    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 21:49:05.052867 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.052797    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 21:49:05.053278 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.053251    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 21:49:05.053404 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053384    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 21:49:05.053467 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053405    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 21:49:05.053467 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053421    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 21:49:05.053581 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.053571    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.053631 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.053564    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 21:49:05.053631 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053624    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 21:49:05.053631 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053631    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 21:49:05.053773 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053701    2568 factory.go:55] Registering systemd factory
Jul 16 21:49:05.053773 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053716    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 16 21:49:05.054135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053983    2568 factory.go:153] Registering CRI-O factory
Jul 16 21:49:05.054135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.053995    2568 factory.go:223] Registration of the crio container factory successfully
Jul 16 21:49:05.054135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.054050    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 21:49:05.054135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.054074    2568 factory.go:103] Registering Raw factory
Jul 16 21:49:05.054135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.054088    2568 manager.go:1196] Started watching for new ooms in manager
Jul 16 21:49:05.054365 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.053311    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380dfe9921a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.044083226 +0000 UTC m=+0.348180584,LastTimestamp:2026-07-16 21:49:05.044083226 +0000 UTC m=+0.348180584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.054599 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.054585    2568 manager.go:349] Starting recovery of all containers
Jul 16 21:49:05.062368 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.062188    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 21:49:05.062488 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.062458    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 21:49:05.062898 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.062884    2568 manager.go:354] Recovery completed
Jul 16 21:49:05.070055 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.070040    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.071768 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.071742    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.071864 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.071785    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.071864 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.071797    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.072320 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.072306    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 21:49:05.072320 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.072320    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 21:49:05.072413 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.072335    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:49:05.072413 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.072352    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.073450 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.073434    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.073551 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.073467    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.073551 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.073485    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.074512 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.074501    2568 policy_none.go:49] "None policy: Start"
Jul 16 21:49:05.074628 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.074517    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 21:49:05.074628 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.074549    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 21:49:05.074797 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.074638    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380e18fffda  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-223.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.071767514 +0000 UTC m=+0.375864874,LastTimestamp:2026-07-16 21:49:05.071767514 +0000 UTC m=+0.375864874,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.076698 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.076686    2568 policy_none.go:47] "Start"
Jul 16 21:49:05.085977 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.085909    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380e1905a91  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-223.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.071790737 +0000 UTC m=+0.375888094,LastTimestamp:2026-07-16 21:49:05.071790737 +0000 UTC m=+0.375888094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.091429 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.091348    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380e1908031  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-223.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.071800369 +0000 UTC m=+0.375897727,LastTimestamp:2026-07-16 21:49:05.071800369 +0000 UTC m=+0.375897727,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.101702 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.101626    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-223.ec2.internal.18c2e380e18fffda\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380e18fffda  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-223.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.071767514 +0000 UTC m=+0.375864874,LastTimestamp:2026-07-16 21:49:05.073450271 +0000 UTC m=+0.377547635,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.102687 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.102669    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vhngd"
Jul 16 21:49:05.114269 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114247    2568 manager.go:337] "Starting Device Plugin manager"
Jul 16 21:49:05.114367 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.114281    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 21:49:05.114367 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114293    2568 server.go:87] "Starting device plugin registration server"
Jul 16 21:49:05.114632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114612    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 21:49:05.114727 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114630    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 21:49:05.114727 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114702    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 21:49:05.114817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114782    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 21:49:05.114817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.114788    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 21:49:05.115401 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.115380    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 21:49:05.115481 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.115430    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.116041 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.115979    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-223.ec2.internal.18c2e380e1905a91\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c2e380e1905a91  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-223.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-16 21:49:05.071790737 +0000 UTC m=+0.375888094,LastTimestamp:2026-07-16 21:49:05.073475185 +0000 UTC m=+0.377572551,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 16 21:49:05.120242 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.120224    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vhngd"
Jul 16 21:49:05.214918 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.214878    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.217032 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.215904    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.217032 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.215935    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.217032 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.215947    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.217032 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.215973    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.225456 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.225385    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 21:49:05.226755 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.226734    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 21:49:05.226864 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.226782    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 21:49:05.226864 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.226811    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 21:49:05.226864 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.226852    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 21:49:05.229601 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.229578    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:49:05.232368 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.232354    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.232418 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.232377    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-223.ec2.internal\": node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.290095 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.290063    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.327441 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.327409    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"]
Jul 16 21:49:05.327573 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.327487    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.329082 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.329063    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.329214 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.329099    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.329214 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.329112    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.331412 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.331395    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.331568 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.331545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.331630 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.331595    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.332236 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332218    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.332307 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332256    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.332307 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332267    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.332379 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332218    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.332379 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332332    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.332379 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.332345    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.334583 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.334565    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.334640 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.334603    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:49:05.335359 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.335339    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:49:05.335431 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.335376    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:49:05.335431 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.335391    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:49:05.354178 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.354148    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-223.ec2.internal\" not found" node="ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.355590 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.355567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.355691 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.355601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.355691 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.355624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7fe9da6afc82c85af7e8ff02c28a425-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"b7fe9da6afc82c85af7e8ff02c28a425\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.358603 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.358586    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-223.ec2.internal\" not found" node="ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.390618 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.390585    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.455886 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.455957 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.455957 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7fe9da6afc82c85af7e8ff02c28a425-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"b7fe9da6afc82c85af7e8ff02c28a425\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.456051 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7fe9da6afc82c85af7e8ff02c28a425-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"b7fe9da6afc82c85af7e8ff02c28a425\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.456051 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.456051 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.455967    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a54072f1d898812b48bfd1cc6f042508-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"a54072f1d898812b48bfd1cc6f042508\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.491011 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.490947    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.591671 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.591635    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.656307 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.656278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.662301 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.662281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:05.691954 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.691921    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.793477 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.793419    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.896314 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.896268    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:05.992111 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.992071    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 21:49:05.992760 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:05.992232    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:49:05.996567 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:05.996551    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:06.069809 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.069740    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:49:06.097307 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:06.097277    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 16 21:49:06.123104 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.123072    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:49:06.125103 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.125029    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:44:05 +0000 UTC" deadline="2028-05-02 22:09:45.820837814 +0000 UTC"
Jul 16 21:49:06.125103 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.125078    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15744h20m39.695764975s"
Jul 16 21:49:06.160575 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.160545    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:49:06.227717 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:06.227658    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54072f1d898812b48bfd1cc6f042508.slice/crio-324398368e34f1e7845a96886f0e8331fa1a7a9168fd7d57ac5ed25dd4015393 WatchSource:0}: Error finding container 324398368e34f1e7845a96886f0e8331fa1a7a9168fd7d57ac5ed25dd4015393: Status 404 returned error can't find the container with id 324398368e34f1e7845a96886f0e8331fa1a7a9168fd7d57ac5ed25dd4015393
Jul 16 21:49:06.228007 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:06.227986    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fe9da6afc82c85af7e8ff02c28a425.slice/crio-2a2406cc90f1d0233a8e5949b394f81d9c126a1b25f51ec7be86d171b09a5830 WatchSource:0}: Error finding container 2a2406cc90f1d0233a8e5949b394f81d9c126a1b25f51ec7be86d171b09a5830: Status 404 returned error can't find the container with id 2a2406cc90f1d0233a8e5949b394f81d9c126a1b25f51ec7be86d171b09a5830
Jul 16 21:49:06.234130 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.234114    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:49:06.254261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.254234    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:06.274418 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.274385    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:49:06.278588 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.278554    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 16 21:49:06.301295 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:06.301266    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:49:07.034309 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.034277    2568 apiserver.go:52] "Watching apiserver"
Jul 16 21:49:07.046123 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.046094    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 21:49:07.046598 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.046545    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-bnwzn","openshift-network-operator/iptables-alerter-gv9rr","openshift-ovn-kubernetes/ovnkube-node-mfbp4","kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk","openshift-cluster-node-tuning-operator/tuned-2vlbb","openshift-dns/node-resolver-rnmcr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-g84fn","openshift-multus/multus-rpcx7","openshift-multus/network-metrics-daemon-nxvxh","kube-system/global-pull-secret-syncer-mxv2g","kube-system/konnectivity-agent-8h8mq","openshift-image-registry/node-ca-qcxx7"]
Jul 16 21:49:07.049390 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.049365    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.052415 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.052387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.053870 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.053849    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 21:49:07.054616 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.054597    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.055246 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.055221    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.055354 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.055289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ptkh8\""
Jul 16 21:49:07.055582 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.055562    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.055768 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.055745    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 21:49:07.056513 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.056489    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gt7pf\""
Jul 16 21:49:07.056655 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.056513    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 21:49:07.056655 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.056578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 21:49:07.056655 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.056501    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 21:49:07.057382 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.057352    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.057474 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.057434    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:07.057785 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.057763    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sfk48\""
Jul 16 21:49:07.058522 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.058501    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.059588    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.061958    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064704    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-system-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-os-release\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064767    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-netns\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-hostroot\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-bin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-multus\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-conf-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-konnectivity-ca\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064961    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cnibin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.064985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-k8s-cni-cncf-io\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-daemon-config\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065042    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-agent-certs\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f02dfdea-296f-401d-a667-94f4f3703d59-host\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065092    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f02dfdea-296f-401d-a667-94f4f3703d59-serviceca\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.066448 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tcxv\" (UniqueName: \"kubernetes.io/projected/f02dfdea-296f-401d-a667-94f4f3703d59-kube-api-access-7tcxv\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065189    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cni-binary-copy\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-socket-dir-parent\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-kubelet\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065314    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-multus-certs\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065341    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-etc-kubernetes\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8gd\" (UniqueName: \"kubernetes.io/projected/3baf6a61-9e0d-4a24-a559-88c6fe20f674-kube-api-access-4n8gd\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.065994    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.066268    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.066997    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-whkjc\""
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.067247    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.067504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.067448    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.068117 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.067673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 21:49:07.068117 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.067898    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.069510 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.069486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.069777 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.069758    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 21:49:07.070370 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.070346    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.070463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.070405    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 21:49:07.070587 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.070354    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6ppmw\""
Jul 16 21:49:07.070834 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.070816    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tfjd5\""
Jul 16 21:49:07.070911 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.070847    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.071518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.071325    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.071518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.071473    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rqhrz\""
Jul 16 21:49:07.072091 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.071838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.072205 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.072161    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 21:49:07.072605 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.072339    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:07.072605 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.072416    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:07.073207 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.073185    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bcb4d\""
Jul 16 21:49:07.073299 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.073211    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.073367 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.073349    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.074653 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.074633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.079354 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.075670    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:07.080290 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.080269    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.085113 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.085083    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:49:07.085457 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.085437    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 21:49:07.086553 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.086531    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 21:49:07.086708 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.086687    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 21:49:07.086946 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.086926    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-872gw\""
Jul 16 21:49:07.086998 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.086947    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 21:49:07.087169 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.087154    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 21:49:07.087453 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.087433    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 21:49:07.110942 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.110907    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pztj5"
Jul 16 21:49:07.122190 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.121981    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pztj5"
Jul 16 21:49:07.127147 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.127121    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:49:07.155024 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.154994    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 21:49:07.166333 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-etc-kubernetes\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.166514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8gd\" (UniqueName: \"kubernetes.io/projected/3baf6a61-9e0d-4a24-a559-88c6fe20f674-kube-api-access-4n8gd\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.166514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-etc-kubernetes\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.166514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-slash\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166581    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-netns\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-etc-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-script-lib\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65da7103-865a-413c-bcca-2d9e83a6e05e-iptables-alerter-script\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.166720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.166994 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166758    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.166994 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-netns\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.166994 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-konnectivity-ca\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.166994 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-systemd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.166994 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.166935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-var-lib-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167032    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-k8s-cni-cncf-io\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-agent-certs\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-kubelet\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167122    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-env-overrides\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-k8s-cni-cncf-io\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167150    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-socket-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-device-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-os-release\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.167280 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-multus-certs\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167304    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-log-socket\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-netd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-run-multus-certs\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-sys\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-etc-tuned\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-cnibin\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167447    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-hostroot\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-konnectivity-ca\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-hostroot\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-systemd-units\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-netns\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.167591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8csv\" (UniqueName: \"kubernetes.io/projected/a1868c33-3cdf-4572-8174-3837e1f93882-kube-api-access-k8csv\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w227r\" (UniqueName: \"kubernetes.io/projected/af44682c-aa7d-4460-a5d0-de23c070da96-kube-api-access-w227r\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-hosts-file\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167747    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-ovn\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-sys-fs\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysconfig\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gjc\" (UniqueName: \"kubernetes.io/projected/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-kube-api-access-m2gjc\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-dbus\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f02dfdea-296f-401d-a667-94f4f3703d59-host\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtcs\" (UniqueName: \"kubernetes.io/projected/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-kube-api-access-rvtcs\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-modprobe-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167915    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-socket-dir-parent\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167936    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f02dfdea-296f-401d-a667-94f4f3703d59-host\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-kubelet\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.167977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-var-lib-kubelet\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.168085 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-kubelet\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-os-release\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168086    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-socket-dir-parent\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-kubelet-config\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168136    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-os-release\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168164    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65da7103-865a-413c-bcca-2d9e83a6e05e-host-slash\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168187    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-lib-modules\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-bin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-bin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-multus\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-conf-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-host-var-lib-cni-multus\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168323    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-registration-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168340    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-conf-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-tmp\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzr2d\" (UniqueName: \"kubernetes.io/projected/fedca2ea-0a17-40aa-a5c7-fa242b323072-kube-api-access-mzr2d\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.168835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-daemon-config\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168432    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f02dfdea-296f-401d-a667-94f4f3703d59-serviceca\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168457    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-kubernetes\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168486    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-tmp-dir\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168512    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-node-log\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168584    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168626    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-host\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvgxs\" (UniqueName: \"kubernetes.io/projected/b5da5b51-91bb-4823-8330-830596d81a9a-kube-api-access-jvgxs\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-system-cni-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168737    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-binary-copy\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-system-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-bin\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-system-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168846    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-config\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qvzr\" (UniqueName: \"kubernetes.io/projected/65da7103-865a-413c-bcca-2d9e83a6e05e-kube-api-access-9qvzr\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-conf\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.169432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168911    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f02dfdea-296f-401d-a667-94f4f3703d59-serviceca\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-systemd\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.168981    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-run\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-daemon-config\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovn-node-metrics-cert\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-multus-cni-dir\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169141    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cnibin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tcxv\" (UniqueName: \"kubernetes.io/projected/f02dfdea-296f-401d-a667-94f4f3703d59-kube-api-access-7tcxv\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169174    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cni-binary-copy\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cnibin\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.170067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.169553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3baf6a61-9e0d-4a24-a559-88c6fe20f674-cni-binary-copy\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.171314 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.171289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7818dfc8-cf7c-4081-b2fe-31b5cef0666a-agent-certs\") pod \"konnectivity-agent-8h8mq\" (UID: \"7818dfc8-cf7c-4081-b2fe-31b5cef0666a\") " pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.183809 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.183778    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8gd\" (UniqueName: \"kubernetes.io/projected/3baf6a61-9e0d-4a24-a559-88c6fe20f674-kube-api-access-4n8gd\") pod \"multus-rpcx7\" (UID: \"3baf6a61-9e0d-4a24-a559-88c6fe20f674\") " pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.189118 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.189088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tcxv\" (UniqueName: \"kubernetes.io/projected/f02dfdea-296f-401d-a667-94f4f3703d59-kube-api-access-7tcxv\") pod \"node-ca-qcxx7\" (UID: \"f02dfdea-296f-401d-a667-94f4f3703d59\") " pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.231880 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.231812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" event={"ID":"b7fe9da6afc82c85af7e8ff02c28a425","Type":"ContainerStarted","Data":"2a2406cc90f1d0233a8e5949b394f81d9c126a1b25f51ec7be86d171b09a5830"}
Jul 16 21:49:07.235488 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.235411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"a54072f1d898812b48bfd1cc6f042508","Type":"ContainerStarted","Data":"324398368e34f1e7845a96886f0e8331fa1a7a9168fd7d57ac5ed25dd4015393"}
Jul 16 21:49:07.269509 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269468    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.269509 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269594    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-host\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvgxs\" (UniqueName: \"kubernetes.io/projected/b5da5b51-91bb-4823-8330-830596d81a9a-kube-api-access-jvgxs\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-system-cni-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-system-cni-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269738    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-host\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-binary-copy\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.269802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-bin\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-config\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qvzr\" (UniqueName: \"kubernetes.io/projected/65da7103-865a-413c-bcca-2d9e83a6e05e-kube-api-access-9qvzr\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-conf\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269869    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-systemd\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-run\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovn-node-metrics-cert\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.269980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-slash\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270006    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-etc-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-script-lib\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65da7103-865a-413c-bcca-2d9e83a6e05e-iptables-alerter-script\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.270287 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270164    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-systemd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-var-lib-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-kubelet\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-env-overrides\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270233    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-socket-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-device-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.270272    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-os-release\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-log-socket\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.270343    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:07.770311197 +0000 UTC m=+3.074408575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270349    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-log-socket\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-bin\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-netd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-sys\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-etc-tuned\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270421    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-cnibin\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.271038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-systemd-units\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270471    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-netns\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8csv\" (UniqueName: \"kubernetes.io/projected/a1868c33-3cdf-4572-8174-3837e1f93882-kube-api-access-k8csv\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w227r\" (UniqueName: \"kubernetes.io/projected/af44682c-aa7d-4460-a5d0-de23c070da96-kube-api-access-w227r\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-hosts-file\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-ovn\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270577    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-sys-fs\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270595    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysconfig\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gjc\" (UniqueName: \"kubernetes.io/projected/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-kube-api-access-m2gjc\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270655    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-dbus\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtcs\" (UniqueName: \"kubernetes.io/projected/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-kube-api-access-rvtcs\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270708    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-modprobe-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-var-lib-kubelet\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-kubelet-config\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.271612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270851    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65da7103-865a-413c-bcca-2d9e83a6e05e-host-slash\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270855    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-config\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270907    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65da7103-865a-413c-bcca-2d9e83a6e05e-host-slash\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-etc-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-lib-modules\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.270975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-registration-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271002    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-tmp\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzr2d\" (UniqueName: \"kubernetes.io/projected/fedca2ea-0a17-40aa-a5c7-fa242b323072-kube-api-access-mzr2d\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-kubernetes\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-tmp-dir\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271136    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-node-log\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-node-log\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovnkube-script-lib\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-systemd\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-run\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271406    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.271811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65da7103-865a-413c-bcca-2d9e83a6e05e-iptables-alerter-script\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.272235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-env-overrides\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272220    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-binary-copy\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272268    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-socket-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272325    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-device-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272391    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-os-release\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-var-lib-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272487    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-systemd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272531    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-kubelet\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-ovn\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272688    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272716    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-kubelet-config\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272748    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272776    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-modprobe-d\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e46a5457-5741-462c-8660-e759330a19be-dbus\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.272913 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272803    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-cni-netd\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.272944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysctl-conf\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedca2ea-0a17-40aa-a5c7-fa242b323072-cnibin\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273039    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-etc-selinux\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-systemd-units\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.273129    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-run-netns\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.273189    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:07.77316892 +0000 UTC m=+3.077266267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fedca2ea-0a17-40aa-a5c7-fa242b323072-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-var-lib-kubelet\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-registration-dir\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273484    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-run-openvswitch\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273542    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-hosts-file\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-sysconfig\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.273724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.273584    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-host-slash\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.274491 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.274030    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1868c33-3cdf-4572-8174-3837e1f93882-sys-fs\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.274491 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.274049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-lib-modules\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.274491 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.274103    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-etc-kubernetes\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.274491 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.274121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5da5b51-91bb-4823-8330-830596d81a9a-sys\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.274724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.274570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-tmp-dir\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.275138 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.275117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-ovn-node-metrics-cert\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.276447 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.276421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-tmp\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.276558 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.276448    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5da5b51-91bb-4823-8330-830596d81a9a-etc-tuned\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.297259 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.297169    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qvzr\" (UniqueName: \"kubernetes.io/projected/65da7103-865a-413c-bcca-2d9e83a6e05e-kube-api-access-9qvzr\") pod \"iptables-alerter-gv9rr\" (UID: \"65da7103-865a-413c-bcca-2d9e83a6e05e\") " pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.297259 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.297201    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvgxs\" (UniqueName: \"kubernetes.io/projected/b5da5b51-91bb-4823-8330-830596d81a9a-kube-api-access-jvgxs\") pod \"tuned-2vlbb\" (UID: \"b5da5b51-91bb-4823-8330-830596d81a9a\") " pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.298344 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.298307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gjc\" (UniqueName: \"kubernetes.io/projected/5fcd7322-99a0-43b3-bd32-85e80fd6e25e-kube-api-access-m2gjc\") pod \"node-resolver-rnmcr\" (UID: \"5fcd7322-99a0-43b3-bd32-85e80fd6e25e\") " pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.302415 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.302386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtcs\" (UniqueName: \"kubernetes.io/projected/48a1a57f-f2c1-4dd5-86c7-decf7075abd9-kube-api-access-rvtcs\") pod \"ovnkube-node-mfbp4\" (UID: \"48a1a57f-f2c1-4dd5-86c7-decf7075abd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.303027 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.303005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8csv\" (UniqueName: \"kubernetes.io/projected/a1868c33-3cdf-4572-8174-3837e1f93882-kube-api-access-k8csv\") pod \"aws-ebs-csi-driver-node-wzcpk\" (UID: \"a1868c33-3cdf-4572-8174-3837e1f93882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.303027 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.303015    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:07.303166 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.303046    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:07.303166 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.303064    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:07.303166 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.303145    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:07.803120942 +0000 UTC m=+3.107218291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:07.303518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.303498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzr2d\" (UniqueName: \"kubernetes.io/projected/fedca2ea-0a17-40aa-a5c7-fa242b323072-kube-api-access-mzr2d\") pod \"multus-additional-cni-plugins-g84fn\" (UID: \"fedca2ea-0a17-40aa-a5c7-fa242b323072\") " pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.304087 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.304066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w227r\" (UniqueName: \"kubernetes.io/projected/af44682c-aa7d-4460-a5d0-de23c070da96-kube-api-access-w227r\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.372900 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.372864    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rpcx7"
Jul 16 21:49:07.380862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.380835    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:07.390856 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.390831    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qcxx7"
Jul 16 21:49:07.397816 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.397793    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk"
Jul 16 21:49:07.404699 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.404673    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vlbb"
Jul 16 21:49:07.412853 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.412825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g84fn"
Jul 16 21:49:07.421344 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.421320    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnmcr"
Jul 16 21:49:07.430357 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.430331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gv9rr"
Jul 16 21:49:07.437359 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.437335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:07.775504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.775412    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:07.775504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.775465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:07.775721 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.775600    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:07.775721 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.775626    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:07.775721 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.775675    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:08.775652629 +0000 UTC m=+4.079749976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:07.775721 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.775704    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:08.775691833 +0000 UTC m=+4.079789182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:07.876186 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:07.876144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:07.876354 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.876325    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:07.876354 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.876341    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:07.876354 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.876355    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:07.876493 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:07.876411    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:08.876395247 +0000 UTC m=+4.180492595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:08.128549 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.128414    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:07 +0000 UTC" deadline="2028-01-26 18:25:10.189540657 +0000 UTC"
Jul 16 21:49:08.128549 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.128475    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13412h36m2.061069272s"
Jul 16 21:49:08.227502 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.227465    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:08.227713 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.227643    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:08.489518 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.489477    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5da5b51_91bb_4823_8330_830596d81a9a.slice/crio-07661e6bea63dc44a6a908235a70fba0deb1f4059acee0ce8b2cc8cb672405f4 WatchSource:0}: Error finding container 07661e6bea63dc44a6a908235a70fba0deb1f4059acee0ce8b2cc8cb672405f4: Status 404 returned error can't find the container with id 07661e6bea63dc44a6a908235a70fba0deb1f4059acee0ce8b2cc8cb672405f4
Jul 16 21:49:08.492727 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.492645    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7818dfc8_cf7c_4081_b2fe_31b5cef0666a.slice/crio-2a9f04f55cd6ac98c6974c2654da026b684636b80137280d04dc0e049c95f246 WatchSource:0}: Error finding container 2a9f04f55cd6ac98c6974c2654da026b684636b80137280d04dc0e049c95f246: Status 404 returned error can't find the container with id 2a9f04f55cd6ac98c6974c2654da026b684636b80137280d04dc0e049c95f246
Jul 16 21:49:08.495753 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.495731    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedca2ea_0a17_40aa_a5c7_fa242b323072.slice/crio-61d89a8f7b5207ab361b36d50f286cd3bac824943f670348a6860e3c66b2382c WatchSource:0}: Error finding container 61d89a8f7b5207ab361b36d50f286cd3bac824943f670348a6860e3c66b2382c: Status 404 returned error can't find the container with id 61d89a8f7b5207ab361b36d50f286cd3bac824943f670348a6860e3c66b2382c
Jul 16 21:49:08.500371 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.497343    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65da7103_865a_413c_bcca_2d9e83a6e05e.slice/crio-e2afcab1fbbdef4f199dabc9b78eb33994ffd8c85879305e6a5f230a0a83daf0 WatchSource:0}: Error finding container e2afcab1fbbdef4f199dabc9b78eb33994ffd8c85879305e6a5f230a0a83daf0: Status 404 returned error can't find the container with id e2afcab1fbbdef4f199dabc9b78eb33994ffd8c85879305e6a5f230a0a83daf0
Jul 16 21:49:08.500371 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.498087    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1868c33_3cdf_4572_8174_3837e1f93882.slice/crio-a8ed12a0e135c0aa58c67917f8caa21cec24618165e3fa9ba6d7714009b34aff WatchSource:0}: Error finding container a8ed12a0e135c0aa58c67917f8caa21cec24618165e3fa9ba6d7714009b34aff: Status 404 returned error can't find the container with id a8ed12a0e135c0aa58c67917f8caa21cec24618165e3fa9ba6d7714009b34aff
Jul 16 21:49:08.501517 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.501415    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02dfdea_296f_401d_a667_94f4f3703d59.slice/crio-fea738ad2fae30f11bb2ecf84fee06724206900801d6a3ff5b3237b1e8222910 WatchSource:0}: Error finding container fea738ad2fae30f11bb2ecf84fee06724206900801d6a3ff5b3237b1e8222910: Status 404 returned error can't find the container with id fea738ad2fae30f11bb2ecf84fee06724206900801d6a3ff5b3237b1e8222910
Jul 16 21:49:08.502461 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.502423    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a1a57f_f2c1_4dd5_86c7_decf7075abd9.slice/crio-c96021971eea7964e7200b244d8925086010897207d5e03b8729bbfe97160e96 WatchSource:0}: Error finding container c96021971eea7964e7200b244d8925086010897207d5e03b8729bbfe97160e96: Status 404 returned error can't find the container with id c96021971eea7964e7200b244d8925086010897207d5e03b8729bbfe97160e96
Jul 16 21:49:08.503568 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.503539    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcd7322_99a0_43b3_bd32_85e80fd6e25e.slice/crio-8a8e58f034764793941f8a938a2de0df1739aa49c63971119da318be2cef03d7 WatchSource:0}: Error finding container 8a8e58f034764793941f8a938a2de0df1739aa49c63971119da318be2cef03d7: Status 404 returned error can't find the container with id 8a8e58f034764793941f8a938a2de0df1739aa49c63971119da318be2cef03d7
Jul 16 21:49:08.509034 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:08.508654    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3baf6a61_9e0d_4a24_a559_88c6fe20f674.slice/crio-fc0cba3fe76bea150482315d521be7d7bfac00edb949a506f7f287febde79df8 WatchSource:0}: Error finding container fc0cba3fe76bea150482315d521be7d7bfac00edb949a506f7f287febde79df8: Status 404 returned error can't find the container with id fc0cba3fe76bea150482315d521be7d7bfac00edb949a506f7f287febde79df8
Jul 16 21:49:08.784210 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.784167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:08.784371 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.784225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:08.784371 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.784334    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:08.784504 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.784420    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:10.784401269 +0000 UTC m=+6.088498641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:08.784504 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.784334    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:08.784651 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.784510    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:10.784492351 +0000 UTC m=+6.088589698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:08.885562 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:08.885511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:08.885776 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.885731    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:08.885776 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.885758    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:08.885776 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.885771    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:08.885917 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:08.885830    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:10.88581164 +0000 UTC m=+6.189908987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:09.128854 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.128714    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:07 +0000 UTC" deadline="2028-03-03 19:35:14.296923857 +0000 UTC"
Jul 16 21:49:09.128854 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.128786    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14301h46m5.168142581s"
Jul 16 21:49:09.230384 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.230336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:09.230582 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:09.230501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:09.230955 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.230937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:09.231082 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:09.231035    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:09.254168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.254006    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"c96021971eea7964e7200b244d8925086010897207d5e03b8729bbfe97160e96"}
Jul 16 21:49:09.260887 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.260754    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qcxx7" event={"ID":"f02dfdea-296f-401d-a667-94f4f3703d59","Type":"ContainerStarted","Data":"fea738ad2fae30f11bb2ecf84fee06724206900801d6a3ff5b3237b1e8222910"}
Jul 16 21:49:09.263830 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.263735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerStarted","Data":"61d89a8f7b5207ab361b36d50f286cd3bac824943f670348a6860e3c66b2382c"}
Jul 16 21:49:09.275858 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.275779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk" event={"ID":"a1868c33-3cdf-4572-8174-3837e1f93882","Type":"ContainerStarted","Data":"a8ed12a0e135c0aa58c67917f8caa21cec24618165e3fa9ba6d7714009b34aff"}
Jul 16 21:49:09.291241 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.291196    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h8mq" event={"ID":"7818dfc8-cf7c-4081-b2fe-31b5cef0666a","Type":"ContainerStarted","Data":"2a9f04f55cd6ac98c6974c2654da026b684636b80137280d04dc0e049c95f246"}
Jul 16 21:49:09.316656 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.316617    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vlbb" event={"ID":"b5da5b51-91bb-4823-8330-830596d81a9a","Type":"ContainerStarted","Data":"07661e6bea63dc44a6a908235a70fba0deb1f4059acee0ce8b2cc8cb672405f4"}
Jul 16 21:49:09.336692 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.336638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" event={"ID":"b7fe9da6afc82c85af7e8ff02c28a425","Type":"ContainerStarted","Data":"2dd7a7c461443e5cbd9636928a6b39e8f21ebf88f1a50381532f0d020593dca3"}
Jul 16 21:49:09.351346 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.351304    2568 generic.go:356] "Generic (PLEG): container finished" podID="a54072f1d898812b48bfd1cc6f042508" containerID="8e2da0c27259212c65f3fbedcfff140a37d8411815ac9e5429265918c8e9955a" exitCode=0
Jul 16 21:49:09.351552 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.351406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"a54072f1d898812b48bfd1cc6f042508","Type":"ContainerDied","Data":"8e2da0c27259212c65f3fbedcfff140a37d8411815ac9e5429265918c8e9955a"}
Jul 16 21:49:09.357429 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.357387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gv9rr" event={"ID":"65da7103-865a-413c-bcca-2d9e83a6e05e","Type":"ContainerStarted","Data":"e2afcab1fbbdef4f199dabc9b78eb33994ffd8c85879305e6a5f230a0a83daf0"}
Jul 16 21:49:09.384229 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.384161    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" podStartSLOduration=3.384135343 podStartE2EDuration="3.384135343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:09.359838924 +0000 UTC m=+4.663936296" watchObservedRunningTime="2026-07-16 21:49:09.384135343 +0000 UTC m=+4.688232715"
Jul 16 21:49:09.399313 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.398842    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnmcr" event={"ID":"5fcd7322-99a0-43b3-bd32-85e80fd6e25e","Type":"ContainerStarted","Data":"8a8e58f034764793941f8a938a2de0df1739aa49c63971119da318be2cef03d7"}
Jul 16 21:49:09.402554 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:09.402522    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpcx7" event={"ID":"3baf6a61-9e0d-4a24-a559-88c6fe20f674","Type":"ContainerStarted","Data":"fc0cba3fe76bea150482315d521be7d7bfac00edb949a506f7f287febde79df8"}
Jul 16 21:49:10.227463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:10.227417    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:10.227963 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.227585    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:10.413227 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:10.413134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"a54072f1d898812b48bfd1cc6f042508","Type":"ContainerStarted","Data":"c155fea2e034dbafc5bc282d1a6cfd8dbcc1cd5bcd26e5a7bc9ddaeb18e0f8b5"}
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:10.804161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:10.804229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.804399    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.804467    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:14.804447798 +0000 UTC m=+10.108545146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.804910    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:10.805010 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.804963    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:14.804946996 +0000 UTC m=+10.109044351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:10.905868 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:10.905253    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:10.905868 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.905422    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:10.905868 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.905444    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:10.905868 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.905458    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:10.905868 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:10.905516    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:14.90549638 +0000 UTC m=+10.209593726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:11.228614 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:11.228276    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:11.228614 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:11.228421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:11.228614 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:11.228507    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:11.228614 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:11.228417    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:12.227733 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:12.227358    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:12.227733 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:12.227682    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:13.229463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:13.228639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:13.229463 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:13.228816    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:13.229463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:13.229230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:13.230164 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:13.230117    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:14.228455 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:14.227996    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:14.228455 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.228124    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:14.838658 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:14.838592    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:14.839124 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:14.838738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:14.839124 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.838764    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:14.839124 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.838843    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:22.838820798 +0000 UTC m=+18.142918146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:14.839124 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.838851    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:14.839124 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.838898    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:22.838885893 +0000 UTC m=+18.142983238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:14.940623 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:14.940004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:14.940623 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.940174    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:14.940623 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.940192    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:14.940623 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.940205    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:14.940623 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:14.940266    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:22.940249262 +0000 UTC m=+18.244346624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:15.228291 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:15.228205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:15.228459 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:15.228336    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:15.228732 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:15.228700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:15.228868 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:15.228828    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:16.227149 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:16.227106    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:16.227598 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:16.227213    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:17.227814 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:17.227311    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:17.227814 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:17.227474    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:17.228576 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:17.228547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:17.228747 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:17.228725    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:18.227919 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:18.227885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:18.228385 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:18.227993    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:19.227645 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:19.227604    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:19.227841 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:19.227617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:19.227841 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:19.227770    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:19.227949 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:19.227897    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:20.227848 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:20.227810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:20.228033 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:20.227959    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:21.227727 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:21.227694    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:21.227909 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:21.227832    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:21.227909 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:21.227892    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:21.228028 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:21.228004    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:22.228047 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:22.228009    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:22.228601 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:22.228143    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:22.902465 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:22.902422    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:22.902737 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:22.902481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:22.902737 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:22.902613    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:22.902737 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:22.902613    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:22.902737 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:22.902681    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:49:38.902664441 +0000 UTC m=+34.206761790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:22.902737 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:22.902697    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:38.902689459 +0000 UTC m=+34.206786804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:23.002880 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:23.002842    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:23.003056 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.002989    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:23.003056 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.003015    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:23.003056 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.003025    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:23.003180 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.003077    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:39.003064211 +0000 UTC m=+34.307161555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:23.227339 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:23.227255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:23.227494 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:23.227255    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:23.227494 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.227377    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:23.227494 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:23.227439    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:24.227195 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:24.227152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:24.227722 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:24.227287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:25.228179 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:25.228145    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:25.228614 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:25.228261    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:25.228614 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:25.228575    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:25.228720 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:25.228653    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:26.227243 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:26.227205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:26.227442 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:26.227343    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:27.228307 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:27.227799    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:27.228307 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:27.227934    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:27.228307 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:27.227985    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:27.228307 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:27.228090    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:28.228283 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.227927    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:28.228471 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:28.228413    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:28.456790 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.456404    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rpcx7" event={"ID":"3baf6a61-9e0d-4a24-a559-88c6fe20f674","Type":"ContainerStarted","Data":"1013aa12493ed0d45f305b8d953a5496f58df7ed7b83028d4963a0ab8a5fe864"}
Jul 16 21:49:28.460135 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460098    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"25edff5fe2591eefc77d357f8d6a29c879bd00f0b8dfbc1229100b8e5b7bf587"}
Jul 16 21:49:28.460310 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"4f87c9288b888d440eed7a3ca99134aa5c428a2063b99ae1f5936ff310081a81"}
Jul 16 21:49:28.460310 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"9cc7ba8f8bff6bb7104cc08c49f899e321b0504ab8a8f398c397ade29a9c9a6d"}
Jul 16 21:49:28.460310 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"13ea0b0aabbfcf80cf2b3c8c5f412630e26b2a0912b574df6af775d55646fb89"}
Jul 16 21:49:28.460461 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"7edde5d9fd93873cd560e807229362c02632488ab5b4ad137932448e377c36eb"}
Jul 16 21:49:28.460461 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.460376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"0dde91adbdf9028882bd0c1b151b75704b429bc82399a8d6519badadc50bd4ab"}
Jul 16 21:49:28.461837 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.461810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qcxx7" event={"ID":"f02dfdea-296f-401d-a667-94f4f3703d59","Type":"ContainerStarted","Data":"77c88d30ec3dccc4b96319dd741d07918a8b288b39360f1ed18b17ef2b9a6561"}
Jul 16 21:49:28.463495 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.463469    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="15db234a8503b4494ea9bb549223b4699b7255620c16e81061d27575856938d6" exitCode=0
Jul 16 21:49:28.463642 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.463573    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"15db234a8503b4494ea9bb549223b4699b7255620c16e81061d27575856938d6"}
Jul 16 21:49:28.465439 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.465364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk" event={"ID":"a1868c33-3cdf-4572-8174-3837e1f93882","Type":"ContainerStarted","Data":"1eaee1687f7f96d006d46d868c08a6ae5f80a44e2e6b164deb63032b63e1dc17"}
Jul 16 21:49:28.466973 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.466948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h8mq" event={"ID":"7818dfc8-cf7c-4081-b2fe-31b5cef0666a","Type":"ContainerStarted","Data":"f5b6eb4341f36a758ff882d60f5adcd0c74ec63cd6edb1827c1e51f6aa1a82df"}
Jul 16 21:49:28.468755 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.468732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vlbb" event={"ID":"b5da5b51-91bb-4823-8330-830596d81a9a","Type":"ContainerStarted","Data":"4c62ba1b35df35206f7e96ab59813732f0eb0e0b0be1ded4a6dae994a5eb25f3"}
Jul 16 21:49:28.470400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.470380    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnmcr" event={"ID":"5fcd7322-99a0-43b3-bd32-85e80fd6e25e","Type":"ContainerStarted","Data":"267f88a4b62fb8c8918f26ce324a73fcf92596fd0d9a2677a29bbb7e33f1aa65"}
Jul 16 21:49:28.478997 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.478951    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" podStartSLOduration=22.478937413 podStartE2EDuration="22.478937413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:10.435322886 +0000 UTC m=+5.739420253" watchObservedRunningTime="2026-07-16 21:49:28.478937413 +0000 UTC m=+23.783034780"
Jul 16 21:49:28.496265 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.496205    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rpcx7" podStartSLOduration=4.466412622 podStartE2EDuration="23.49619093s" totalImagesPullingTime="19.029778308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:28.479212689 +0000 UTC m=+23.783310149" watchObservedRunningTime="2026-07-16 21:49:28.49619093 +0000 UTC m=+23.800288296"
Jul 16 21:49:28.496435 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.496416    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qcxx7" podStartSLOduration=4.5280706649999996 podStartE2EDuration="23.496410292s" totalImagesPullingTime="18.968339627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:28.49634895 +0000 UTC m=+23.800446306" watchObservedRunningTime="2026-07-16 21:49:28.496410292 +0000 UTC m=+23.800507659"
Jul 16 21:49:28.520022 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.519972    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2vlbb" podStartSLOduration=4.518030853 podStartE2EDuration="23.519955627s" totalImagesPullingTime="19.001924774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:28.51942254 +0000 UTC m=+23.823519908" watchObservedRunningTime="2026-07-16 21:49:28.519955627 +0000 UTC m=+23.824052993"
Jul 16 21:49:28.571373 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.571322    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8h8mq" podStartSLOduration=8.414493907 podStartE2EDuration="23.571305853s" totalImagesPullingTime="15.156811946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:28.570858695 +0000 UTC m=+23.874956062" watchObservedRunningTime="2026-07-16 21:49:28.571305853 +0000 UTC m=+23.875403220"
Jul 16 21:49:28.588823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.588774    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rnmcr" podStartSLOduration=4.62206296 podStartE2EDuration="23.588758531s" totalImagesPullingTime="18.966695571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:28.588699811 +0000 UTC m=+23.892797178" watchObservedRunningTime="2026-07-16 21:49:28.588758531 +0000 UTC m=+23.892855898"
Jul 16 21:49:28.868811 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:28.868785    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 21:49:29.126149 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.126004    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:49:28.868804412Z","UUID":"2209341f-6db0-4583-89d7-a894f4a59ddf","Handler":null,"Name":"","Endpoint":""}
Jul 16 21:49:29.127579 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.127561    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 21:49:29.127695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.127594    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 21:49:29.228030 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.227995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:29.228189 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:29.228107    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:29.228189 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.228167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:29.228305 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:29.228263    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:29.475617 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.475511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk" event={"ID":"a1868c33-3cdf-4572-8174-3837e1f93882","Type":"ContainerStarted","Data":"ec268032922cd47e8e4a44b4f70ce6e249d397d3452f8f0ab05d3a0a10b5a15b"}
Jul 16 21:49:29.477315 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.477280    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gv9rr" event={"ID":"65da7103-865a-413c-bcca-2d9e83a6e05e","Type":"ContainerStarted","Data":"aea2983f8a9fa7b19a4eb94096359dbc7846cc045fb899a7cf8672e853ab1761"}
Jul 16 21:49:29.498292 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:29.498230    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gv9rr" podStartSLOduration=5.5238414670000004 podStartE2EDuration="24.498212595s" totalImagesPullingTime="18.974371128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:29.49693787 +0000 UTC m=+24.801035228" watchObservedRunningTime="2026-07-16 21:49:29.498212595 +0000 UTC m=+24.802310004"
Jul 16 21:49:30.227569 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:30.227474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:30.227714 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:30.227597    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:30.484178 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:30.484082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"de43d0eb7c5d88e0ec685c26f62aca30106af7a12a4fc4dbcb54f012e409f564"}
Jul 16 21:49:30.487120 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:30.487078    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk" event={"ID":"a1868c33-3cdf-4572-8174-3837e1f93882","Type":"ContainerStarted","Data":"79c71dbd60d112e23f0b6cbe3a7df7cddb02e2274228d7304720c0ed63ea15ee"}
Jul 16 21:49:30.532110 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:30.532041    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wzcpk" podStartSLOduration=4.425127502 podStartE2EDuration="25.532019514s" totalImagesPullingTime="21.106892012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:30.531859341 +0000 UTC m=+25.835956708" watchObservedRunningTime="2026-07-16 21:49:30.532019514 +0000 UTC m=+25.836116881"
Jul 16 21:49:31.228868 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:31.228652    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:31.229064 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:31.228726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:31.229064 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:31.228985    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:31.229064 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:31.229053    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:32.159481 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:32.159445    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:32.160119 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:32.160098    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:32.227930 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:32.227899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:32.228117 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:32.228025    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:32.491671 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:32.491644    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:32.492117 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:32.492099    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8h8mq"
Jul 16 21:49:33.227718 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:33.227681    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:33.228357 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:33.227808    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:33.228357 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:33.227859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:33.228357 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:33.228018    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:34.228172 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.228001    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:34.228708 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:34.228251    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:34.499806 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.499718    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" event={"ID":"48a1a57f-f2c1-4dd5-86c7-decf7075abd9","Type":"ContainerStarted","Data":"a883d8b68fb8d71d24c17d7359f8f53fc5181f03b7083c7a66ddfad910b9b5b1"}
Jul 16 21:49:34.500014 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.499993    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:34.501662 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.501638    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="1c2e2d5bfcf12d1e8cee3e984b03ad68c7d587c74bd9793173d1fc5e9115411d" exitCode=0
Jul 16 21:49:34.501782 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.501724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"1c2e2d5bfcf12d1e8cee3e984b03ad68c7d587c74bd9793173d1fc5e9115411d"}
Jul 16 21:49:34.516695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.516668    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:34.583803 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:34.583753    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4" podStartSLOduration=9.544256889 podStartE2EDuration="28.5837371s" totalImagesPullingTime="19.039480211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:34.546140535 +0000 UTC m=+29.850237901" watchObservedRunningTime="2026-07-16 21:49:34.5837371 +0000 UTC m=+29.887834467"
Jul 16 21:49:35.228781 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.228747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:35.229302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.228831    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:35.229302 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:35.228859    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:35.229302 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:35.228958    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:35.504710 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.504636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:35.504840 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.504714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:35.520339 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.520289    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:49:35.929357 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.929315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxv2g"]
Jul 16 21:49:35.929533 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.929423    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:35.929589 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:35.929516    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:35.933052 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.933021    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxvxh"]
Jul 16 21:49:35.933165 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.933152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:35.933288 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:35.933266    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:35.933553 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.933496    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnwzn"]
Jul 16 21:49:35.933649 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:35.933629    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:35.933789 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:35.933709    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:36.510737 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:36.510694    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="8b65b20a11eb43ae17b8e8d73278577e14ab9a87ebe886ce201617a86f09e760" exitCode=0
Jul 16 21:49:36.511160 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:36.510785    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"8b65b20a11eb43ae17b8e8d73278577e14ab9a87ebe886ce201617a86f09e760"}
Jul 16 21:49:37.228099 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:37.228065    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:37.228254 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:37.228066    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:37.228254 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:37.228209    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:37.228254 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:37.228228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:37.228372 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:37.228329    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:37.228408 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:37.228393    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:38.521238 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:38.521205    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="d4ce0859ffd08367bf6979226a527cc086c80a341918f2733ccd22815472e644" exitCode=0
Jul 16 21:49:38.521790 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:38.521252    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"d4ce0859ffd08367bf6979226a527cc086c80a341918f2733ccd22815472e644"}
Jul 16 21:49:38.931047 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:38.931009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:38.931211 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:38.931055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:38.931211 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:38.931169    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:38.931211 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:38.931169    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:38.931318 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:38.931235    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret podName:e46a5457-5741-462c-8660-e759330a19be nodeName:}" failed. No retries permitted until 2026-07-16 21:50:10.931217886 +0000 UTC m=+66.235315234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret") pod "global-pull-secret-syncer-mxv2g" (UID: "e46a5457-5741-462c-8660-e759330a19be") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:49:38.931318 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:38.931251    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs podName:af44682c-aa7d-4460-a5d0-de23c070da96 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:10.931243196 +0000 UTC m=+66.235340541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs") pod "network-metrics-daemon-nxvxh" (UID: "af44682c-aa7d-4460-a5d0-de23c070da96") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:49:39.031912 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:39.031880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:39.032084 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.032000    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:49:39.032084 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.032015    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:49:39.032084 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.032024    2568 projected.go:196] Error preparing data for projected volume kube-api-access-vf2zl for pod openshift-network-diagnostics/network-check-target-bnwzn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:39.032084 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.032076    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl podName:9b4980ec-d8dd-4dc2-8181-bf3b71798db5 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:11.032062301 +0000 UTC m=+66.336159645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vf2zl" (UniqueName: "kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl") pod "network-check-target-bnwzn" (UID: "9b4980ec-d8dd-4dc2-8181-bf3b71798db5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:39.227487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:39.227515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:39.227487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.227637    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mxv2g" podUID="e46a5457-5741-462c-8660-e759330a19be"
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.227751    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bnwzn" podUID="9b4980ec-d8dd-4dc2-8181-bf3b71798db5"
Jul 16 21:49:39.228043 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:39.227830    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxvxh" podUID="af44682c-aa7d-4460-a5d0-de23c070da96"
Jul 16 21:49:40.542241 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.542212    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeReady"
Jul 16 21:49:40.542890 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.542397    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 21:49:40.615152 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.615112    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5fjxg"]
Jul 16 21:49:40.617467 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.617443    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.620748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.620725    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 21:49:40.621073 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.621051    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 21:49:40.621401 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.621380    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5kfkb\""
Jul 16 21:49:40.621744 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.621723    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sksgz"]
Jul 16 21:49:40.623615 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.623595    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.626884 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.626841    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 21:49:40.627124 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.627108    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vlpp9\""
Jul 16 21:49:40.627564 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.627547    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 21:49:40.627633 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.627590    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 21:49:40.633991 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.633968    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5fjxg"]
Jul 16 21:49:40.642270 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.642244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sksgz"]
Jul 16 21:49:40.741430 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741395    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gm29\" (UniqueName: \"kubernetes.io/projected/65d54f38-e603-47fd-9794-b53ca161709b-kube-api-access-4gm29\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.741627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65d54f38-e603-47fd-9794-b53ca161709b-config-volume\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.741627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.741627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d54f38-e603-47fd-9794-b53ca161709b-tmp-dir\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.741627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741604    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c1c841-cd28-4429-ba49-80ddc8415b94-cert\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.741826 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.741641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfb2\" (UniqueName: \"kubernetes.io/projected/52c1c841-cd28-4429-ba49-80ddc8415b94-kube-api-access-krfb2\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.842776 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gm29\" (UniqueName: \"kubernetes.io/projected/65d54f38-e603-47fd-9794-b53ca161709b-kube-api-access-4gm29\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.842776 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65d54f38-e603-47fd-9794-b53ca161709b-config-volume\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.842776 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.843056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d54f38-e603-47fd-9794-b53ca161709b-tmp-dir\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.843056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c1c841-cd28-4429-ba49-80ddc8415b94-cert\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.843056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.842848    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfb2\" (UniqueName: \"kubernetes.io/projected/52c1c841-cd28-4429-ba49-80ddc8415b94-kube-api-access-krfb2\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.843056 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:40.842965    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:49:40.843056 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:40.843019    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls podName:65d54f38-e603-47fd-9794-b53ca161709b nodeName:}" failed. No retries permitted until 2026-07-16 21:49:41.34300284 +0000 UTC m=+36.647100186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls") pod "dns-default-5fjxg" (UID: "65d54f38-e603-47fd-9794-b53ca161709b") : secret "dns-default-metrics-tls" not found
Jul 16 21:49:40.843347 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.843326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65d54f38-e603-47fd-9794-b53ca161709b-tmp-dir\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.843470 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.843454    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65d54f38-e603-47fd-9794-b53ca161709b-config-volume\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.847934 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.847906    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c1c841-cd28-4429-ba49-80ddc8415b94-cert\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.854437 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.854387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gm29\" (UniqueName: \"kubernetes.io/projected/65d54f38-e603-47fd-9794-b53ca161709b-kube-api-access-4gm29\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:40.854844 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.854822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfb2\" (UniqueName: \"kubernetes.io/projected/52c1c841-cd28-4429-ba49-80ddc8415b94-kube-api-access-krfb2\") pod \"ingress-canary-sksgz\" (UID: \"52c1c841-cd28-4429-ba49-80ddc8415b94\") " pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:40.936840 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:40.936797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sksgz"
Jul 16 21:49:41.107182 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.106920    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sksgz"]
Jul 16 21:49:41.111761 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:41.111736    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c1c841_cd28_4429_ba49_80ddc8415b94.slice/crio-41559a7629bf6a1fb2db28fe536c82e96af744e34d558c6aafb29ec2d31b904e WatchSource:0}: Error finding container 41559a7629bf6a1fb2db28fe536c82e96af744e34d558c6aafb29ec2d31b904e: Status 404 returned error can't find the container with id 41559a7629bf6a1fb2db28fe536c82e96af744e34d558c6aafb29ec2d31b904e
Jul 16 21:49:41.227899 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.227860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:49:41.228063 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.227896    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:49:41.228063 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.227860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:49:41.231440 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.231416    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:49:41.231627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.231453    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:49:41.231627 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.231517    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:49:41.231906 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.231886    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:49:41.232838 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.232815    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjnvp\""
Jul 16 21:49:41.232838 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.232831    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xnvp2\""
Jul 16 21:49:41.347203 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.347162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:41.347374 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:41.347309    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:49:41.347374 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:41.347371    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls podName:65d54f38-e603-47fd-9794-b53ca161709b nodeName:}" failed. No retries permitted until 2026-07-16 21:49:42.347355497 +0000 UTC m=+37.651452843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls") pod "dns-default-5fjxg" (UID: "65d54f38-e603-47fd-9794-b53ca161709b") : secret "dns-default-metrics-tls" not found
Jul 16 21:49:41.534145 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:41.534102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sksgz" event={"ID":"52c1c841-cd28-4429-ba49-80ddc8415b94","Type":"ContainerStarted","Data":"41559a7629bf6a1fb2db28fe536c82e96af744e34d558c6aafb29ec2d31b904e"}
Jul 16 21:49:42.355721 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:42.355681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:42.356253 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:42.355842    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:49:42.356253 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:42.355909    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls podName:65d54f38-e603-47fd-9794-b53ca161709b nodeName:}" failed. No retries permitted until 2026-07-16 21:49:44.355890819 +0000 UTC m=+39.659988179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls") pod "dns-default-5fjxg" (UID: "65d54f38-e603-47fd-9794-b53ca161709b") : secret "dns-default-metrics-tls" not found
Jul 16 21:49:43.542087 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:43.542050    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="60253a9287f6f3bfec935c10df2dc770bb033b54b73e51d6305ed296c9087846" exitCode=0
Jul 16 21:49:43.542652 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:43.542103    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"60253a9287f6f3bfec935c10df2dc770bb033b54b73e51d6305ed296c9087846"}
Jul 16 21:49:44.373497 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:44.373457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:44.373698 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:44.373660    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:49:44.373773 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:44.373747    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls podName:65d54f38-e603-47fd-9794-b53ca161709b nodeName:}" failed. No retries permitted until 2026-07-16 21:49:48.373723943 +0000 UTC m=+43.677821294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls") pod "dns-default-5fjxg" (UID: "65d54f38-e603-47fd-9794-b53ca161709b") : secret "dns-default-metrics-tls" not found
Jul 16 21:49:44.548510 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:44.548474    2568 generic.go:356] "Generic (PLEG): container finished" podID="fedca2ea-0a17-40aa-a5c7-fa242b323072" containerID="eeddcb731c570a2e5cfda7439b1d6934161dd63f7a5e62c0b0a05e0d57aef2bb" exitCode=0
Jul 16 21:49:44.548884 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:44.548561    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerDied","Data":"eeddcb731c570a2e5cfda7439b1d6934161dd63f7a5e62c0b0a05e0d57aef2bb"}
Jul 16 21:49:45.557102 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:45.556841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g84fn" event={"ID":"fedca2ea-0a17-40aa-a5c7-fa242b323072","Type":"ContainerStarted","Data":"498964de27febf0abb0e37c8d359ad869be87905d60e25b2882d8c09299417cb"}
Jul 16 21:49:45.558248 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:45.558221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sksgz" event={"ID":"52c1c841-cd28-4429-ba49-80ddc8415b94","Type":"ContainerStarted","Data":"627ac2ce512fd8234be42fc2f6a058d3959059821b0e37377e8c746696760312"}
Jul 16 21:49:45.588419 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:45.588363    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g84fn" podStartSLOduration=10.360336121 podStartE2EDuration="40.588348959s" totalImagesPullingTime="30.228012838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:45.586679872 +0000 UTC m=+40.890777238" watchObservedRunningTime="2026-07-16 21:49:45.588348959 +0000 UTC m=+40.892446326"
Jul 16 21:49:47.208206 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.208151    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sksgz" podStartSLOduration=3.6792648249999997 podStartE2EDuration="7.208131623s" totalImagesPullingTime="3.528866798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:45.608997324 +0000 UTC m=+40.913094688" watchObservedRunningTime="2026-07-16 21:49:47.208131623 +0000 UTC m=+42.512228989"
Jul 16 21:49:47.208826 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.208717    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"]
Jul 16 21:49:47.242854 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.242823    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"
Jul 16 21:49:47.246167 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.246136    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 21:49:47.247433 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.247414    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 21:49:47.247539 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.247414    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x29ss\""
Jul 16 21:49:47.256543 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.256507    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"]
Jul 16 21:49:47.362959 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.362929    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fswkf"]
Jul 16 21:49:47.379936 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.379902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.383137 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.383113    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 21:49:47.383274 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.383156    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 21:49:47.383274 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.383180    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 21:49:47.383274 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.383160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 21:49:47.383837 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.383821    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vv8qm\""
Jul 16 21:49:47.393694 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.393669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9jw\" (UniqueName: \"kubernetes.io/projected/ecee6785-b126-4c41-b0e2-179442b27344-kube-api-access-cj9jw\") pod \"migrator-7cc9c7ffd7-ghbjb\" (UID: \"ecee6785-b126-4c41-b0e2-179442b27344\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"
Jul 16 21:49:47.397283 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.397262    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fswkf"]
Jul 16 21:49:47.495102 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495009    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.495102 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkh2n\" (UniqueName: \"kubernetes.io/projected/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-api-access-jkh2n\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.495102 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9jw\" (UniqueName: \"kubernetes.io/projected/ecee6785-b126-4c41-b0e2-179442b27344-kube-api-access-cj9jw\") pod \"migrator-7cc9c7ffd7-ghbjb\" (UID: \"ecee6785-b126-4c41-b0e2-179442b27344\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"
Jul 16 21:49:47.495332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.495332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495192    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-crio-socket\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.495332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.495213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-data-volume\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.509235 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.509208    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9jw\" (UniqueName: \"kubernetes.io/projected/ecee6785-b126-4c41-b0e2-179442b27344-kube-api-access-cj9jw\") pod \"migrator-7cc9c7ffd7-ghbjb\" (UID: \"ecee6785-b126-4c41-b0e2-179442b27344\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"
Jul 16 21:49:47.552764 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.552730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"
Jul 16 21:49:47.596007 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.595967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596169 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596023    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-crio-socket\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596169 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-data-volume\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596169 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:47.596095    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:47.596184    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:47.596192    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:48.096170578 +0000 UTC m=+43.400267947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : configmap "kube-rbac-proxy" not found
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-crio-socket\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:47.596230    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:48.096217878 +0000 UTC m=+43.400315223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:47.596305 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkh2n\" (UniqueName: \"kubernetes.io/projected/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-api-access-jkh2n\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.596723 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.596361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-data-volume\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.605903 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.605876    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkh2n\" (UniqueName: \"kubernetes.io/projected/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-api-access-jkh2n\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:47.703709 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:47.703679    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb"]
Jul 16 21:49:47.706421 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:47.706396    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecee6785_b126_4c41_b0e2_179442b27344.slice/crio-064c3ad1ad873c92631b1a49e188d335a41a3404358be8d01f1e6a8b90406480 WatchSource:0}: Error finding container 064c3ad1ad873c92631b1a49e188d335a41a3404358be8d01f1e6a8b90406480: Status 404 returned error can't find the container with id 064c3ad1ad873c92631b1a49e188d335a41a3404358be8d01f1e6a8b90406480
Jul 16 21:49:48.101200 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:48.101161    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:48.101200 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:48.101213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:48.101418 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.101293    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:49:48.101418 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.101323    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:48.101418 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.101356    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:49.101337388 +0000 UTC m=+44.405434754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : configmap "kube-rbac-proxy" not found
Jul 16 21:49:48.101418 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.101379    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:49.101364049 +0000 UTC m=+44.405461394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:48.404488 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:48.404450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:48.404896 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.404631    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:49:48.404896 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:48.404698    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls podName:65d54f38-e603-47fd-9794-b53ca161709b nodeName:}" failed. No retries permitted until 2026-07-16 21:49:56.404682893 +0000 UTC m=+51.708780238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls") pod "dns-default-5fjxg" (UID: "65d54f38-e603-47fd-9794-b53ca161709b") : secret "dns-default-metrics-tls" not found
Jul 16 21:49:48.567514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:48.567474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb" event={"ID":"ecee6785-b126-4c41-b0e2-179442b27344","Type":"ContainerStarted","Data":"064c3ad1ad873c92631b1a49e188d335a41a3404358be8d01f1e6a8b90406480"}
Jul 16 21:49:49.110096 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:49.110052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:49.110272 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:49.110178    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:49:49.110272 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:49.110245    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:51.110225515 +0000 UTC m=+46.414322861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : configmap "kube-rbac-proxy" not found
Jul 16 21:49:49.110272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:49.110180    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:49.110272 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:49.110258    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:49.110484 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:49.110309    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:51.110290124 +0000 UTC m=+46.414387473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:49.572070 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:49.572039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb" event={"ID":"ecee6785-b126-4c41-b0e2-179442b27344","Type":"ContainerStarted","Data":"957d0c0b6708d56007ece389dee92792af010d0cbcdc91487b4287ba12e40014"}
Jul 16 21:49:50.144362 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:50.144330    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnmcr_5fcd7322-99a0-43b3-bd32-85e80fd6e25e/dns-node-resolver/0.log"
Jul 16 21:49:50.576536 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:50.576434    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb" event={"ID":"ecee6785-b126-4c41-b0e2-179442b27344","Type":"ContainerStarted","Data":"dbdc832410aebc0e67a12e21a84d7d9772508e2f13b500f3c261a5f7ea2a5346"}
Jul 16 21:49:51.125744 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:51.125702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:51.126035 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:51.125812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:51.126035 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:51.125829    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:49:51.126035 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:51.125897    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:55.125882121 +0000 UTC m=+50.429979465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : configmap "kube-rbac-proxy" not found
Jul 16 21:49:51.126035 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:51.125932    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:51.126035 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:51.125995    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:49:55.125979524 +0000 UTC m=+50.430076872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:51.343393 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:51.343362    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qcxx7_f02dfdea-296f-401d-a667-94f4f3703d59/node-ca/0.log"
Jul 16 21:49:51.944062 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:51.944027    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sksgz_52c1c841-cd28-4429-ba49-80ddc8415b94/serve-healthcheck-canary/0.log"
Jul 16 21:49:52.345430 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:52.345365    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ghbjb_ecee6785-b126-4c41-b0e2-179442b27344/migrator/0.log"
Jul 16 21:49:52.544841 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:52.544812    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ghbjb_ecee6785-b126-4c41-b0e2-179442b27344/graceful-termination/0.log"
Jul 16 21:49:55.159331 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:55.159286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:55.159834 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:55.159403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:49:55.159834 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:55.159413    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:49:55.159834 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:55.159501    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:50:03.159459081 +0000 UTC m=+58.463556426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : configmap "kube-rbac-proxy" not found
Jul 16 21:49:55.159834 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:55.159558    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:55.159834 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:49:55.159618    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls podName:e3ffcaaf-2702-42f3-9edf-f9a35b032ffc nodeName:}" failed. No retries permitted until 2026-07-16 21:50:03.159600557 +0000 UTC m=+58.463697905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fswkf" (UID: "e3ffcaaf-2702-42f3-9edf-f9a35b032ffc") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:49:56.469075 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:56.469036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:56.471492 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:56.471467    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65d54f38-e603-47fd-9794-b53ca161709b-metrics-tls\") pod \"dns-default-5fjxg\" (UID: \"65d54f38-e603-47fd-9794-b53ca161709b\") " pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:56.529674 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:56.529640    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:56.685449 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:56.685389    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ghbjb" podStartSLOduration=8.023125927 podStartE2EDuration="9.685370737s" totalImagesPullingTime="1.66224481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:50.596393967 +0000 UTC m=+45.900491333" watchObservedRunningTime="2026-07-16 21:49:56.685370737 +0000 UTC m=+51.989468104"
Jul 16 21:49:56.685817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:56.685795    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5fjxg"]
Jul 16 21:49:56.690027 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:49:56.690002    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d54f38_e603_47fd_9794_b53ca161709b.slice/crio-fc2df06e9f47f38656606decbed295464c9baff18cecf2afcd4532dadfe2314f WatchSource:0}: Error finding container fc2df06e9f47f38656606decbed295464c9baff18cecf2afcd4532dadfe2314f: Status 404 returned error can't find the container with id fc2df06e9f47f38656606decbed295464c9baff18cecf2afcd4532dadfe2314f
Jul 16 21:49:57.594221 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:57.594175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fjxg" event={"ID":"65d54f38-e603-47fd-9794-b53ca161709b","Type":"ContainerStarted","Data":"fc2df06e9f47f38656606decbed295464c9baff18cecf2afcd4532dadfe2314f"}
Jul 16 21:49:59.601187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:59.601148    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fjxg" event={"ID":"65d54f38-e603-47fd-9794-b53ca161709b","Type":"ContainerStarted","Data":"0d743d91a66a7c0da55b82fe800fa490ec2edecb205b69dbe25d2ea48430b320"}
Jul 16 21:49:59.601625 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:59.601204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fjxg" event={"ID":"65d54f38-e603-47fd-9794-b53ca161709b","Type":"ContainerStarted","Data":"d667fede49a584334c69d1079dc56177644cea66badc8b7a7b5bbc7739ef995b"}
Jul 16 21:49:59.601625 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:59.601268    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:49:59.624838 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:49:59.624789    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5fjxg" podStartSLOduration=17.479837285 podStartE2EDuration="19.624774005s" totalImagesPullingTime="2.14493672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:59.62451172 +0000 UTC m=+54.928609086" watchObservedRunningTime="2026-07-16 21:49:59.624774005 +0000 UTC m=+54.928871349"
Jul 16 21:50:03.219230 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.219188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:50:03.219644 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.219283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:50:03.219766 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.219747    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:50:03.221834 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.221812    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3ffcaaf-2702-42f3-9edf-f9a35b032ffc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fswkf\" (UID: \"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc\") " pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:50:03.288898 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.288862    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fswkf"
Jul 16 21:50:03.422461 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.422397    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fswkf"]
Jul 16 21:50:03.426154 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:03.426130    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ffcaaf_2702_42f3_9edf_f9a35b032ffc.slice/crio-521280f22d78b16ab4ce6f8f66088b1ef71d7269ee6ea42d13ca6672aef2fdf4 WatchSource:0}: Error finding container 521280f22d78b16ab4ce6f8f66088b1ef71d7269ee6ea42d13ca6672aef2fdf4: Status 404 returned error can't find the container with id 521280f22d78b16ab4ce6f8f66088b1ef71d7269ee6ea42d13ca6672aef2fdf4
Jul 16 21:50:03.611749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:03.611667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fswkf" event={"ID":"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc","Type":"ContainerStarted","Data":"521280f22d78b16ab4ce6f8f66088b1ef71d7269ee6ea42d13ca6672aef2fdf4"}
Jul 16 21:50:07.528494 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:07.528455    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfbp4"
Jul 16 21:50:08.628092 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:08.628053    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fswkf" event={"ID":"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc","Type":"ContainerStarted","Data":"81d42c88924782f29bf69d7c784c004b5db1eff68b58388d18c529daa5869ad2"}
Jul 16 21:50:09.606243 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:09.606212    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5fjxg"
Jul 16 21:50:10.984664 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.984612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:50:10.985106 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.984681    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:50:10.987880 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.987853    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:50:10.989097 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.989062    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:50:10.998032 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.997993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e46a5457-5741-462c-8660-e759330a19be-original-pull-secret\") pod \"global-pull-secret-syncer-mxv2g\" (UID: \"e46a5457-5741-462c-8660-e759330a19be\") " pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:50:10.998162 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:10.998097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af44682c-aa7d-4460-a5d0-de23c070da96-metrics-certs\") pod \"network-metrics-daemon-nxvxh\" (UID: \"af44682c-aa7d-4460-a5d0-de23c070da96\") " pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:50:11.085911 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.085864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:50:11.089428 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.089404    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:50:11.099828 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.099798    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:50:11.110389 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.110356    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf2zl\" (UniqueName: \"kubernetes.io/projected/9b4980ec-d8dd-4dc2-8181-bf3b71798db5-kube-api-access-vf2zl\") pod \"network-check-target-bnwzn\" (UID: \"9b4980ec-d8dd-4dc2-8181-bf3b71798db5\") " pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:50:11.244017 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.243948    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xnvp2\""
Jul 16 21:50:11.248009 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.247991    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mxv2g"
Jul 16 21:50:11.251038 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.251021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxvxh"
Jul 16 21:50:11.256269 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.256243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xjnvp\""
Jul 16 21:50:11.264379 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:11.264352    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:50:12.164158 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.164128    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bnwzn"]
Jul 16 21:50:12.178696 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:12.178654    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4980ec_d8dd_4dc2_8181_bf3b71798db5.slice/crio-544dfc77a165a4358fad33613633c71ed6ad8dacffb553512e2d4a473b7dc17e WatchSource:0}: Error finding container 544dfc77a165a4358fad33613633c71ed6ad8dacffb553512e2d4a473b7dc17e: Status 404 returned error can't find the container with id 544dfc77a165a4358fad33613633c71ed6ad8dacffb553512e2d4a473b7dc17e
Jul 16 21:50:12.194909 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:12.194869    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf44682c_aa7d_4460_a5d0_de23c070da96.slice/crio-9381fec35b0580a7471af9abe53bfb6b94c52feca334fbdd4fc156a09569361f WatchSource:0}: Error finding container 9381fec35b0580a7471af9abe53bfb6b94c52feca334fbdd4fc156a09569361f: Status 404 returned error can't find the container with id 9381fec35b0580a7471af9abe53bfb6b94c52feca334fbdd4fc156a09569361f
Jul 16 21:50:12.201624 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.201595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxvxh"]
Jul 16 21:50:12.296259 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.296161    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65ff4bbc6f-gk55q"]
Jul 16 21:50:12.332446 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.332415    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65ff4bbc6f-gk55q"]
Jul 16 21:50:12.332629 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.332548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.337886 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.337857    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 21:50:12.337886 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.337878    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdgnt\""
Jul 16 21:50:12.338052 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.337926    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 21:50:12.338178 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.338165    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 21:50:12.343399 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.343377    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 21:50:12.355376 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.355356    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mxv2g"]
Jul 16 21:50:12.356986 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:12.356955    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46a5457_5741_462c_8660_e759330a19be.slice/crio-54274581b53f24e62b36e7263f3088807a8152818779e76b1b8db57f0d8fff34 WatchSource:0}: Error finding container 54274581b53f24e62b36e7263f3088807a8152818779e76b1b8db57f0d8fff34: Status 404 returned error can't find the container with id 54274581b53f24e62b36e7263f3088807a8152818779e76b1b8db57f0d8fff34
Jul 16 21:50:12.394847 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394806    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b090031-0bb8-41ae-a514-4db924a5b526-ca-trust-extracted\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.394847 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394848    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-installation-pull-secrets\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-registry-certificates\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-image-registry-private-configuration\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-trusted-ca\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.394971    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-bound-sa-token\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.395008    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-kube-api-access-bpvg6\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.395061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.395028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-registry-tls\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496062 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-kube-api-access-bpvg6\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-registry-tls\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b090031-0bb8-41ae-a514-4db924a5b526-ca-trust-extracted\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-installation-pull-secrets\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-registry-certificates\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496199    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-image-registry-private-configuration\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496223    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-trusted-ca\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-bound-sa-token\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.496755 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.496718    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b090031-0bb8-41ae-a514-4db924a5b526-ca-trust-extracted\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.497238 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.497213    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-trusted-ca\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.497469 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.497446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b090031-0bb8-41ae-a514-4db924a5b526-registry-certificates\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.498810 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.498788    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-installation-pull-secrets\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.498904 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.498835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b090031-0bb8-41ae-a514-4db924a5b526-image-registry-private-configuration\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.498981 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.498911    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-registry-tls\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.517431 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.517401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpvg6\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-kube-api-access-bpvg6\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.517879 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.517861    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b090031-0bb8-41ae-a514-4db924a5b526-bound-sa-token\") pod \"image-registry-65ff4bbc6f-gk55q\" (UID: \"0b090031-0bb8-41ae-a514-4db924a5b526\") " pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.641170 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.641138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:12.644542 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.644480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fswkf" event={"ID":"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc","Type":"ContainerStarted","Data":"0394f45a2b7053ea9e303707b3d7ee58aca3d265ec475f0ef5c4775a12b9851c"}
Jul 16 21:50:12.645799 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.645774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxv2g" event={"ID":"e46a5457-5741-462c-8660-e759330a19be","Type":"ContainerStarted","Data":"54274581b53f24e62b36e7263f3088807a8152818779e76b1b8db57f0d8fff34"}
Jul 16 21:50:12.647224 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.647197    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxvxh" event={"ID":"af44682c-aa7d-4460-a5d0-de23c070da96","Type":"ContainerStarted","Data":"9381fec35b0580a7471af9abe53bfb6b94c52feca334fbdd4fc156a09569361f"}
Jul 16 21:50:12.648388 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.648367    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnwzn" event={"ID":"9b4980ec-d8dd-4dc2-8181-bf3b71798db5","Type":"ContainerStarted","Data":"544dfc77a165a4358fad33613633c71ed6ad8dacffb553512e2d4a473b7dc17e"}
Jul 16 21:50:12.841002 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:12.840901    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65ff4bbc6f-gk55q"]
Jul 16 21:50:12.842986 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:12.842954    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b090031_0bb8_41ae_a514_4db924a5b526.slice/crio-0ea6ffe4cc6331e714b89fd2a991b917002e809b835fe46c00a1b832b7a43e8b WatchSource:0}: Error finding container 0ea6ffe4cc6331e714b89fd2a991b917002e809b835fe46c00a1b832b7a43e8b: Status 404 returned error can't find the container with id 0ea6ffe4cc6331e714b89fd2a991b917002e809b835fe46c00a1b832b7a43e8b
Jul 16 21:50:13.655170 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:13.655128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q" event={"ID":"0b090031-0bb8-41ae-a514-4db924a5b526","Type":"ContainerStarted","Data":"6749a730705661317ec2be68f0107e3766c917b49a4de5c396dc3acf9649162a"}
Jul 16 21:50:13.655758 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:13.655196    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q" event={"ID":"0b090031-0bb8-41ae-a514-4db924a5b526","Type":"ContainerStarted","Data":"0ea6ffe4cc6331e714b89fd2a991b917002e809b835fe46c00a1b832b7a43e8b"}
Jul 16 21:50:13.655967 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:13.655944    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:13.702693 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:13.702072    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q" podStartSLOduration=1.702050136 podStartE2EDuration="1.702050136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:13.701888665 +0000 UTC m=+69.005986034" watchObservedRunningTime="2026-07-16 21:50:13.702050136 +0000 UTC m=+69.006147503"
Jul 16 21:50:14.661722 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:14.661553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxvxh" event={"ID":"af44682c-aa7d-4460-a5d0-de23c070da96","Type":"ContainerStarted","Data":"135732a017da0483b16d757b7f44dbf42d35fa31a4c738e7a97afe88e06ccdd2"}
Jul 16 21:50:14.661722 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:14.661660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxvxh" event={"ID":"af44682c-aa7d-4460-a5d0-de23c070da96","Type":"ContainerStarted","Data":"649e091ef292c2ad6aedee22e8c20f19123e73835ff75f19065d0643a47086d5"}
Jul 16 21:50:14.687467 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:14.686937    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxvxh" podStartSLOduration=68.108126572 podStartE2EDuration="1m9.686913066s" totalImagesPullingTime="1.578786494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:14.685727298 +0000 UTC m=+69.989824678" watchObservedRunningTime="2026-07-16 21:50:14.686913066 +0000 UTC m=+69.991010434"
Jul 16 21:50:19.680931 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.680889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fswkf" event={"ID":"e3ffcaaf-2702-42f3-9edf-f9a35b032ffc","Type":"ContainerStarted","Data":"9571b7171d0804c2f26709942a2e9b80f133f045755e3ac8d8d429f36f8de489"}
Jul 16 21:50:19.682344 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.682307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mxv2g" event={"ID":"e46a5457-5741-462c-8660-e759330a19be","Type":"ContainerStarted","Data":"09a496f411c90ffc0ff98581bb15bf2dfa84d89a43b571f680a0fdf5dd541502"}
Jul 16 21:50:19.683759 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.683730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bnwzn" event={"ID":"9b4980ec-d8dd-4dc2-8181-bf3b71798db5","Type":"ContainerStarted","Data":"c18a71b997ccac4f0c572be19c3ba2dd4fc993a38254edc1a82f562e36501ade"}
Jul 16 21:50:19.683877 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.683864    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:50:19.704370 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.704322    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fswkf" podStartSLOduration=17.285283861 podStartE2EDuration="32.704308263s" totalImagesPullingTime="15.419024402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:19.703969258 +0000 UTC m=+75.008066626" watchObservedRunningTime="2026-07-16 21:50:19.704308263 +0000 UTC m=+75.008405629"
Jul 16 21:50:19.724597 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.724548    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bnwzn" podStartSLOduration=67.91899158 podStartE2EDuration="1m14.72451026s" totalImagesPullingTime="6.80551868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:19.723973413 +0000 UTC m=+75.028070780" watchObservedRunningTime="2026-07-16 21:50:19.72451026 +0000 UTC m=+75.028607626"
Jul 16 21:50:19.741933 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:19.741885    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mxv2g" podStartSLOduration=67.109632252 podStartE2EDuration="1m13.741870312s" totalImagesPullingTime="6.63223806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:19.74132813 +0000 UTC m=+75.045425498" watchObservedRunningTime="2026-07-16 21:50:19.741870312 +0000 UTC m=+75.045967679"
Jul 16 21:50:35.669575 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:35.669537    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65ff4bbc6f-gk55q"
Jul 16 21:50:36.451849 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.451806    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"]
Jul 16 21:50:36.457696 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.457676    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.460402 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.460384    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-grd5t\""
Jul 16 21:50:36.463321 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.463303    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 21:50:36.464778 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.464760    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 21:50:36.464778 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.464777    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 21:50:36.464931 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.464793    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 21:50:36.464931 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.464781    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 21:50:36.477703 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.477674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"]
Jul 16 21:50:36.510187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.510150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zjqzf"]
Jul 16 21:50:36.516073 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.516047    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.520646 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.520626    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 21:50:36.520646 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.520626    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 21:50:36.520898 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.520885    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 21:50:36.521456 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.521440    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jjtv5\""
Jul 16 21:50:36.559093 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.559044    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73fe4c0-7e6c-4008-94ef-759893e86309-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.559263 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.559114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.559263 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.559170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pp9m\" (UniqueName: \"kubernetes.io/projected/b73fe4c0-7e6c-4008-94ef-759893e86309-kube-api-access-2pp9m\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.559263 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.559216    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.660162 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-textfile\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660162 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-wtmp\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73fe4c0-7e6c-4008-94ef-759893e86309-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.660400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-sys\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660251    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-root\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-metrics-client-ca\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660301    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pp9m\" (UniqueName: \"kubernetes.io/projected/b73fe4c0-7e6c-4008-94ef-759893e86309-kube-api-access-2pp9m\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.660682 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjt5x\" (UniqueName: \"kubernetes.io/projected/04e7b928-0367-4766-a853-8d7297d5d1e8-kube-api-access-gjt5x\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.660939 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.660891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73fe4c0-7e6c-4008-94ef-759893e86309-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.663289 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.663260    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.663289 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.663282    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b73fe4c0-7e6c-4008-94ef-759893e86309-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.674115 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.674085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pp9m\" (UniqueName: \"kubernetes.io/projected/b73fe4c0-7e6c-4008-94ef-759893e86309-kube-api-access-2pp9m\") pod \"openshift-state-metrics-79f6958cdf-dnb5g\" (UID: \"b73fe4c0-7e6c-4008-94ef-759893e86309\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.761234 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761234 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761234 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761234 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjt5x\" (UniqueName: \"kubernetes.io/projected/04e7b928-0367-4766-a853-8d7297d5d1e8-kube-api-access-gjt5x\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761258    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-textfile\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-wtmp\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-sys\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-root\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-metrics-client-ca\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:50:36.761417    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-wtmp\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-sys\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:50:36.761490    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls podName:04e7b928-0367-4766-a853-8d7297d5d1e8 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:37.261468793 +0000 UTC m=+92.565566140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls") pod "node-exporter-zjqzf" (UID: "04e7b928-0367-4766-a853-8d7297d5d1e8") : secret "node-exporter-tls" not found
Jul 16 21:50:36.761591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04e7b928-0367-4766-a853-8d7297d5d1e8-root\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.762021 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.762021 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-textfile\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.762021 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.761875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04e7b928-0367-4766-a853-8d7297d5d1e8-metrics-client-ca\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.763713 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.763692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.766722 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.766703    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"
Jul 16 21:50:36.789166 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.789141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjt5x\" (UniqueName: \"kubernetes.io/projected/04e7b928-0367-4766-a853-8d7297d5d1e8-kube-api-access-gjt5x\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:36.997486 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:36.997455    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g"]
Jul 16 21:50:37.001882 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:37.001853    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73fe4c0_7e6c_4008_94ef_759893e86309.slice/crio-523fc28b6b70ea486ee1ba335441f8b6592ef2a70dbeac7389b7787ee207811c WatchSource:0}: Error finding container 523fc28b6b70ea486ee1ba335441f8b6592ef2a70dbeac7389b7787ee207811c: Status 404 returned error can't find the container with id 523fc28b6b70ea486ee1ba335441f8b6592ef2a70dbeac7389b7787ee207811c
Jul 16 21:50:37.265502 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.265461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:37.267895 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.267875    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04e7b928-0367-4766-a853-8d7297d5d1e8-node-exporter-tls\") pod \"node-exporter-zjqzf\" (UID: \"04e7b928-0367-4766-a853-8d7297d5d1e8\") " pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:37.425028 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.424999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zjqzf"
Jul 16 21:50:37.453663 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:37.453635    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e7b928_0367_4766_a853_8d7297d5d1e8.slice/crio-3eff52c584916b613be3b54530fac3e214faece9dcf4e24afd20f8f06d642d70 WatchSource:0}: Error finding container 3eff52c584916b613be3b54530fac3e214faece9dcf4e24afd20f8f06d642d70: Status 404 returned error can't find the container with id 3eff52c584916b613be3b54530fac3e214faece9dcf4e24afd20f8f06d642d70
Jul 16 21:50:37.741213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.741127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zjqzf" event={"ID":"04e7b928-0367-4766-a853-8d7297d5d1e8","Type":"ContainerStarted","Data":"3eff52c584916b613be3b54530fac3e214faece9dcf4e24afd20f8f06d642d70"}
Jul 16 21:50:37.743019 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.742991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g" event={"ID":"b73fe4c0-7e6c-4008-94ef-759893e86309","Type":"ContainerStarted","Data":"c5a29f2b523105c5408e5db5dabadb24c25b7fe4de9cee19e2d8fd75624b833c"}
Jul 16 21:50:37.743143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.743049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g" event={"ID":"b73fe4c0-7e6c-4008-94ef-759893e86309","Type":"ContainerStarted","Data":"4b6d6021c4b7bd2ae09a7cfc31900d0c1ceb4c154b8fdbbbf243ac78edc0c432"}
Jul 16 21:50:37.743143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:37.743075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g" event={"ID":"b73fe4c0-7e6c-4008-94ef-759893e86309","Type":"ContainerStarted","Data":"523fc28b6b70ea486ee1ba335441f8b6592ef2a70dbeac7389b7787ee207811c"}
Jul 16 21:50:39.491025 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.490988    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"]
Jul 16 21:50:39.494437 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.494419    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.499617 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.499596    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rg452\""
Jul 16 21:50:39.499617 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.499575    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 21:50:39.499834 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.499821    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 21:50:39.499888 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.499854    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 21:50:39.500831 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.500795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bso5r46s95u6\""
Jul 16 21:50:39.500831 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.500795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 21:50:39.501009 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.500804    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 21:50:39.511504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.511477    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"]
Jul 16 21:50:39.583831 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.583831 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvc9m\" (UniqueName: \"kubernetes.io/projected/041618fa-bbe9-475d-9b89-f6dbabd3bea3-kube-api-access-gvc9m\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584028 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583876    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-grpc-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584028 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583924    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584028 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584028 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.583987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584180 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.584068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.584180 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.584130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041618fa-bbe9-475d-9b89-f6dbabd3bea3-metrics-client-ca\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.684839 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.684839 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684870    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041618fa-bbe9-475d-9b89-f6dbabd3bea3-metrics-client-ca\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvc9m\" (UniqueName: \"kubernetes.io/projected/041618fa-bbe9-475d-9b89-f6dbabd3bea3-kube-api-access-gvc9m\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-grpc-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685100 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.684992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.685717 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.685689    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/041618fa-bbe9-475d-9b89-f6dbabd3bea3-metrics-client-ca\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688405 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-grpc-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688405 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688550 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-tls\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688550 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688550 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.688804 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.688783    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/041618fa-bbe9-475d-9b89-f6dbabd3bea3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.697314 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.697278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvc9m\" (UniqueName: \"kubernetes.io/projected/041618fa-bbe9-475d-9b89-f6dbabd3bea3-kube-api-access-gvc9m\") pod \"thanos-querier-56b9df4b9d-htdtr\" (UID: \"041618fa-bbe9-475d-9b89-f6dbabd3bea3\") " pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.751885 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.751799    2568 generic.go:356] "Generic (PLEG): container finished" podID="04e7b928-0367-4766-a853-8d7297d5d1e8" containerID="7edd39b3c6dcfb4130d6ce488f9872cbff38a32d1fedb4f88f4d4e62f8fc9fdc" exitCode=0
Jul 16 21:50:39.752037 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.751885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zjqzf" event={"ID":"04e7b928-0367-4766-a853-8d7297d5d1e8","Type":"ContainerDied","Data":"7edd39b3c6dcfb4130d6ce488f9872cbff38a32d1fedb4f88f4d4e62f8fc9fdc"}
Jul 16 21:50:39.754071 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.754048    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g" event={"ID":"b73fe4c0-7e6c-4008-94ef-759893e86309","Type":"ContainerStarted","Data":"989cc8f71ca0385c9b4948e69e19f92a3cdc9e8c5010e453b88100863a88af96"}
Jul 16 21:50:39.803507 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.803482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:39.813720 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.813673    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-dnb5g" podStartSLOduration=2.09075277 podStartE2EDuration="3.813652131s" totalImagesPullingTime="1.722899361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:39.813587614 +0000 UTC m=+95.117684982" watchObservedRunningTime="2026-07-16 21:50:39.813652131 +0000 UTC m=+95.117749502"
Jul 16 21:50:39.960080 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:39.960042    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"]
Jul 16 21:50:39.963972 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:39.963919    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041618fa_bbe9_475d_9b89_f6dbabd3bea3.slice/crio-1941f5992d1cf9568f5230c0578dda161956530b6cf86c5a3940c3909afa5841 WatchSource:0}: Error finding container 1941f5992d1cf9568f5230c0578dda161956530b6cf86c5a3940c3909afa5841: Status 404 returned error can't find the container with id 1941f5992d1cf9568f5230c0578dda161956530b6cf86c5a3940c3909afa5841
Jul 16 21:50:40.764285 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.764245    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zjqzf" event={"ID":"04e7b928-0367-4766-a853-8d7297d5d1e8","Type":"ContainerStarted","Data":"6c5be091aceff17c8b3293d5e4b917ef943b44ec0d9330079770aedd70a8e0f1"}
Jul 16 21:50:40.764784 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.764350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zjqzf" event={"ID":"04e7b928-0367-4766-a853-8d7297d5d1e8","Type":"ContainerStarted","Data":"be864f2050dd79e5a3f4812afba8776c15763d2a82ccc0219b611a0323131a57"}
Jul 16 21:50:40.765782 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.765758    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"1941f5992d1cf9568f5230c0578dda161956530b6cf86c5a3940c3909afa5841"}
Jul 16 21:50:40.789861 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.789799    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zjqzf" podStartSLOduration=3.21836318 podStartE2EDuration="4.789777101s" totalImagesPullingTime="1.493012564s" totalInitContainerRuntime="78.401357ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.787962621 +0000 UTC m=+96.092059988" watchObservedRunningTime="2026-07-16 21:50:40.789777101 +0000 UTC m=+96.093874467"
Jul 16 21:50:40.955771 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.955739    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-866995875d-jmtmm"]
Jul 16 21:50:40.958914 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.958887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:40.962586 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.962561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 16 21:50:40.962743 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.962591    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2cctq8qccuvc0\""
Jul 16 21:50:40.962743 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.962632    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 16 21:50:40.962959 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.962936    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-klg72\""
Jul 16 21:50:40.963083 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.963069    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 16 21:50:40.963181 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.963161    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 21:50:40.976732 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:40.976640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-866995875d-jmtmm"]
Jul 16 21:50:41.096670 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-client-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.096670 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhm4\" (UniqueName: \"kubernetes.io/projected/5693ff26-8cde-4751-bf0b-831cc409e292-kube-api-access-xlhm4\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.096872 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096672    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-metrics-server-audit-profiles\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.096872 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.096872 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-tls\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.096872 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-client-certs\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.097084 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.096895    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5693ff26-8cde-4751-bf0b-831cc409e292-audit-log\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-client-certs\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198147    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5693ff26-8cde-4751-bf0b-831cc409e292-audit-log\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198351 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-client-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198351 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhm4\" (UniqueName: \"kubernetes.io/projected/5693ff26-8cde-4751-bf0b-831cc409e292-kube-api-access-xlhm4\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198426 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-metrics-server-audit-profiles\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198468 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198545 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-tls\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.198613 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.198556    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5693ff26-8cde-4751-bf0b-831cc409e292-audit-log\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.199311 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.199281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-metrics-server-audit-profiles\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.199695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.199478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5693ff26-8cde-4751-bf0b-831cc409e292-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.201147 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.201126    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-client-ca-bundle\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.201242 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.201193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-client-certs\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.201335 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.201311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5693ff26-8cde-4751-bf0b-831cc409e292-secret-metrics-server-tls\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.201792 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.201776    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:50:41.205968 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.205949    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.214668 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.214638    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 21:50:41.214668 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.214665    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 21:50:41.215668 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.215642    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 21:50:41.215668 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.215653    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 21:50:41.215853 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.215779    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 21:50:41.215853 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.215789    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 21:50:41.216065 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.216038    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 21:50:41.216173 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.216073    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-llxxv\""
Jul 16 21:50:41.217061 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.217039    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 21:50:41.219398 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.219333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhm4\" (UniqueName: \"kubernetes.io/projected/5693ff26-8cde-4751-bf0b-831cc409e292-kube-api-access-xlhm4\") pod \"metrics-server-866995875d-jmtmm\" (UID: \"5693ff26-8cde-4751-bf0b-831cc409e292\") " pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.221264 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.221244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:50:41.270303 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.270266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:50:41.299497 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299469    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299683 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6cq\" (UniqueName: \"kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299683 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299683 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299683 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299683 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.299918 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.299716    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401137 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401090    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6cq\" (UniqueName: \"kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.401589 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.401320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.402069 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.402036    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.402332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.402069    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.402404 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.402374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.402463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.402418    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.404040 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.404022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.404040 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.404036    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.415679 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.415655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6cq\" (UniqueName: \"kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq\") pod \"console-7b5fb55d49-rsdp4\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") " pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.420252 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.420226    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-866995875d-jmtmm"]
Jul 16 21:50:41.521089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:41.521049    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:41.889541 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:41.889497    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5693ff26_8cde_4751_bf0b_831cc409e292.slice/crio-ca96dd1948db49f094e8e2baccde1eb5c27b50d973f84b15eb3c0239f0e93ab2 WatchSource:0}: Error finding container ca96dd1948db49f094e8e2baccde1eb5c27b50d973f84b15eb3c0239f0e93ab2: Status 404 returned error can't find the container with id ca96dd1948db49f094e8e2baccde1eb5c27b50d973f84b15eb3c0239f0e93ab2
Jul 16 21:50:42.029487 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.029454    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:50:42.032632 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:42.032601    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056f89a1_4d2f_4942_9264_047043d415c1.slice/crio-b2eecea0f51d56902391f30daba80058275c78170e0dfc9ba6fde419ce3c7e36 WatchSource:0}: Error finding container b2eecea0f51d56902391f30daba80058275c78170e0dfc9ba6fde419ce3c7e36: Status 404 returned error can't find the container with id b2eecea0f51d56902391f30daba80058275c78170e0dfc9ba6fde419ce3c7e36
Jul 16 21:50:42.775484 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.775452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5fb55d49-rsdp4" event={"ID":"056f89a1-4d2f-4942-9264-047043d415c1","Type":"ContainerStarted","Data":"b2eecea0f51d56902391f30daba80058275c78170e0dfc9ba6fde419ce3c7e36"}
Jul 16 21:50:42.777871 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.777836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"f36621bbb14ecb872873921db9e1920cf0446bbf6eb8b5cd9a833db6750b17ca"}
Jul 16 21:50:42.778005 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.777912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"5b840171c270bb5b420f5553bc67dae9777ea90a46223c2dcb39c55c43ee4534"}
Jul 16 21:50:42.778005 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.777954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"16e98fa6d2849cc038df28d8fad487a08edc41310e9d193b6b40743398e1c869"}
Jul 16 21:50:42.779337 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.779308    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-866995875d-jmtmm" event={"ID":"5693ff26-8cde-4751-bf0b-831cc409e292","Type":"ContainerStarted","Data":"ca96dd1948db49f094e8e2baccde1eb5c27b50d973f84b15eb3c0239f0e93ab2"}
Jul 16 21:50:42.851166 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.851126    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:50:42.856973 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.856942    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.872626 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.872596    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 21:50:42.873254 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.873235    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 21:50:42.873416 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.873289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 21:50:42.873416 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.873235    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 21:50:42.873549 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.873491    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 21:50:42.874188 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.874160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 21:50:42.876453 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.876300    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 21:50:42.876453 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.876332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 21:50:42.876643 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.876575    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4bg29\""
Jul 16 21:50:42.882213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.881564    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7q0qo7f5mktr9\""
Jul 16 21:50:42.882213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.881686    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 21:50:42.882213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.881897    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 21:50:42.882213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.881948    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 21:50:42.882213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.882076    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 21:50:42.882471 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.882270    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 21:50:42.882471 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.882272    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 21:50:42.914950 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.914919    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.914968    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915011    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915127    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915245    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbt4p\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-kube-api-access-rbt4p\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915340    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915414 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915954 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915954 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915954 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915456    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915954 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.915954 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.915594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:42.935090 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:42.935054    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:50:43.016728 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.016892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016956    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.016994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017053    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbt4p\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-kube-api-access-rbt4p\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017640 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017171    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.017640 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.017214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.018484 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.018455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.018817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.018792    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.019458 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.019430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.019636 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.019614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.020127 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.020102    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.021429 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.021400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.022114 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.022088    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.022742 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.022705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.023295 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.023266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5201fd4c-897e-4bff-b545-ee9d303226d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.023766 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.023741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.024320 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.024271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.025170 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.025151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5201fd4c-897e-4bff-b545-ee9d303226d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.025717 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.025666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.025892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.025867    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.026164 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.026143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.026244 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.026160    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.026569 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.026509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.027951 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.027930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.028483 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.028460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5201fd4c-897e-4bff-b545-ee9d303226d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.030094 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.030051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbt4p\" (UniqueName: \"kubernetes.io/projected/5201fd4c-897e-4bff-b545-ee9d303226d6-kube-api-access-rbt4p\") pod \"prometheus-k8s-0\" (UID: \"5201fd4c-897e-4bff-b545-ee9d303226d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.170513 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.170489    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:50:43.778337 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:50:43.778307    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5201fd4c_897e_4bff_b545_ee9d303226d6.slice/crio-825b76ee942a78feab958f6af9a666f4be11fec7016ad95d77e6cc4710b0ea02 WatchSource:0}: Error finding container 825b76ee942a78feab958f6af9a666f4be11fec7016ad95d77e6cc4710b0ea02: Status 404 returned error can't find the container with id 825b76ee942a78feab958f6af9a666f4be11fec7016ad95d77e6cc4710b0ea02
Jul 16 21:50:43.779014 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.778907    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 21:50:43.788410 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.787878    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"4db11455d4dc70d6d4d578fe7a5922d747bd91ce240b0c544a077a0108f8f11e"}
Jul 16 21:50:43.788410 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.787945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"7632d06438dafec56b94839ce4e7e5b3fd0c2cd97cfd51a8bb9d53526edb3e2d"}
Jul 16 21:50:43.788410 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.787974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" event={"ID":"041618fa-bbe9-475d-9b89-f6dbabd3bea3","Type":"ContainerStarted","Data":"bf572ca826334f9c0dfbcac54ce44d2ca33cf513d7cd44663b8855b379950d16"}
Jul 16 21:50:43.788410 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.788321    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:43.790067 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.790041    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-866995875d-jmtmm" event={"ID":"5693ff26-8cde-4751-bf0b-831cc409e292","Type":"ContainerStarted","Data":"89f9fa5e4f203a5d6cc3086670c4a5f075e64eb5e481359f92b9f078ece4c414"}
Jul 16 21:50:43.791641 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.791609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"825b76ee942a78feab958f6af9a666f4be11fec7016ad95d77e6cc4710b0ea02"}
Jul 16 21:50:43.829276 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.829222    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr" podStartSLOduration=2.020888414 podStartE2EDuration="4.829204598s" totalImagesPullingTime="2.808316184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:43.828663471 +0000 UTC m=+99.132760840" watchObservedRunningTime="2026-07-16 21:50:43.829204598 +0000 UTC m=+99.133301963"
Jul 16 21:50:43.856454 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:43.856343    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-866995875d-jmtmm" podStartSLOduration=2.090883744 podStartE2EDuration="3.856323315s" totalImagesPullingTime="1.765439571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:43.855998876 +0000 UTC m=+99.160096244" watchObservedRunningTime="2026-07-16 21:50:43.856323315 +0000 UTC m=+99.160420681"
Jul 16 21:50:46.805491 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:46.805406    2568 generic.go:356] "Generic (PLEG): container finished" podID="5201fd4c-897e-4bff-b545-ee9d303226d6" containerID="084b1bb1f98854b617242439b00c3d6c97c281d74dc4158b7a5d18903808b684" exitCode=0
Jul 16 21:50:46.805986 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:46.805507    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerDied","Data":"084b1bb1f98854b617242439b00c3d6c97c281d74dc4158b7a5d18903808b684"}
Jul 16 21:50:46.807139 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:46.807108    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5fb55d49-rsdp4" event={"ID":"056f89a1-4d2f-4942-9264-047043d415c1","Type":"ContainerStarted","Data":"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"}
Jul 16 21:50:46.879965 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:46.879915    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b5fb55d49-rsdp4" podStartSLOduration=1.495563046 podStartE2EDuration="5.879898537s" totalImagesPullingTime="4.384335491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:46.877204638 +0000 UTC m=+102.181302004" watchObservedRunningTime="2026-07-16 21:50:46.879898537 +0000 UTC m=+102.183995903"
Jul 16 21:50:47.033917 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:47.033884    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:50:49.804237 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:49.804212    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56b9df4b9d-htdtr"
Jul 16 21:50:50.689715 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.689683    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bnwzn"
Jul 16 21:50:50.826184 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.826153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"e3adaea218db7e108cac7b6db64b91fa02504e2045e646a4ae20daa66e0f4ef4"}
Jul 16 21:50:50.826642 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.826217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"f21cf79a75910c92eafed9ba73519ad13b993b5485049549a95d5b92d844e44c"}
Jul 16 21:50:50.826642 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.826242    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"a77cab472b0f901ed9e4dde4c1e92c4e61545dc67bd474d4c08624070676db8d"}
Jul 16 21:50:50.826642 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.826265    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"e968515faaba87fc3dfb1c4dafbe75c394c1ca278d227d7ab9d8b2c4d80341ea"}
Jul 16 21:50:50.826642 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:50.826286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"a7e008ed973a258b4519c31a4cf365c59abb8fa2772369660bb1dbff1ef083e0"}
Jul 16 21:50:51.521423 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:51.521382    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:50:51.833782 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:51.833705    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5201fd4c-897e-4bff-b545-ee9d303226d6","Type":"ContainerStarted","Data":"3be38e0bf25311d9fa445e27a8bd79fc4829ac1d4d4797c11a732a791f1f04b7"}
Jul 16 21:50:51.871022 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:51.870967    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.8521806119999997 podStartE2EDuration="9.870942712s" totalImagesPullingTime="5.996049034s" totalInitContainerRuntime="22.713066ms" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:51.86868777 +0000 UTC m=+107.172785137" watchObservedRunningTime="2026-07-16 21:50:51.870942712 +0000 UTC m=+107.175040081"
Jul 16 21:50:53.171350 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:50:53.171307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:01.270400 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:01.270360    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:51:01.270826 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:01.270431    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:51:07.450886 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:07.450847    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sksgz_52c1c841-cd28-4429-ba49-80ddc8415b94/serve-healthcheck-canary/0.log"
Jul 16 21:51:13.837873 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:13.837818    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b5fb55d49-rsdp4" podUID="056f89a1-4d2f-4942-9264-047043d415c1" containerName="console" containerID="cri-o://ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d" gracePeriod=15
Jul 16 21:51:14.094027 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.093951    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:51:14.178845 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178803    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.178845 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178854    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178876    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178943    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r6cq\" (UniqueName: \"kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.178988    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179089 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.179011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert\") pod \"056f89a1-4d2f-4942-9264-047043d415c1\" (UID: \"056f89a1-4d2f-4942-9264-047043d415c1\") "
Jul 16 21:51:14.179518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.179470    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config" (OuterVolumeSpecName: "console-config") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:51:14.179518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.179477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:51:14.179518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.179559    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:51:14.179999 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.179543    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:51:14.181326 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.181303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:51:14.181326 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.181303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq" (OuterVolumeSpecName: "kube-api-access-6r6cq") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "kube-api-access-6r6cq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:51:14.181462 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.181386    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "056f89a1-4d2f-4942-9264-047043d415c1" (UID: "056f89a1-4d2f-4942-9264-047043d415c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:51:14.280470 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280432    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-oauth-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280470 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280464    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-trusted-ca-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280470 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280473    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r6cq\" (UniqueName: \"kubernetes.io/projected/056f89a1-4d2f-4942-9264-047043d415c1-kube-api-access-6r6cq\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280482    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280490    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-console-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280498    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056f89a1-4d2f-4942-9264-047043d415c1-oauth-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.280724 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.280506    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056f89a1-4d2f-4942-9264-047043d415c1-console-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:51:14.919399 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.919366    2568 generic.go:356] "Generic (PLEG): container finished" podID="056f89a1-4d2f-4942-9264-047043d415c1" containerID="ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d" exitCode=0
Jul 16 21:51:14.919823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.919453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5fb55d49-rsdp4" event={"ID":"056f89a1-4d2f-4942-9264-047043d415c1","Type":"ContainerDied","Data":"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"}
Jul 16 21:51:14.919823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.919474    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5fb55d49-rsdp4"
Jul 16 21:51:14.919823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.919490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5fb55d49-rsdp4" event={"ID":"056f89a1-4d2f-4942-9264-047043d415c1","Type":"ContainerDied","Data":"b2eecea0f51d56902391f30daba80058275c78170e0dfc9ba6fde419ce3c7e36"}
Jul 16 21:51:14.919823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.919545    2568 scope.go:117] "RemoveContainer" containerID="ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"
Jul 16 21:51:14.930151 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.930127    2568 scope.go:117] "RemoveContainer" containerID="ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"
Jul 16 21:51:14.930456 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:51:14.930425    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d\": container with ID starting with ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d not found: ID does not exist" containerID="ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"
Jul 16 21:51:14.930514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.930466    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d"} err="failed to get container status \"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d\": rpc error: code = NotFound desc = could not find container \"ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d\": container with ID starting with ec6c681420441bc5161843cad742a3022afba3abd2cdfe77a794b0d011b2860d not found: ID does not exist"
Jul 16 21:51:14.944183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.944150    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:51:14.948780 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:14.948748    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b5fb55d49-rsdp4"]
Jul 16 21:51:15.235257 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:15.235178    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="056f89a1-4d2f-4942-9264-047043d415c1" path="/var/lib/kubelet/pods/056f89a1-4d2f-4942-9264-047043d415c1/volumes"
Jul 16 21:51:21.277106 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:21.277073    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:51:21.282039 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:21.282007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-866995875d-jmtmm"
Jul 16 21:51:43.171480 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:43.171443    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:43.192018 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:43.191994    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:51:44.051183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:51:44.051156    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 21:53:34.146634 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.146541    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"]
Jul 16 21:53:34.147095 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.146847    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056f89a1-4d2f-4942-9264-047043d415c1" containerName="console"
Jul 16 21:53:34.147095 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.146858    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="056f89a1-4d2f-4942-9264-047043d415c1" containerName="console"
Jul 16 21:53:34.147095 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.146920    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="056f89a1-4d2f-4942-9264-047043d415c1" containerName="console"
Jul 16 21:53:34.149758 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.149739    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.153159 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.153134    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 21:53:34.153277 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.153215    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hk7b8\""
Jul 16 21:53:34.153487 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.153471    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 21:53:34.153783 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.153766    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 21:53:34.154079 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.154065    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 21:53:34.183828 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.183798    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"]
Jul 16 21:53:34.233686 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.233652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.233686 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.233695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-manifests\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.233900 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.233717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-tmp\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.233900 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.233804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.233900 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.233853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mds9\" (UniqueName: \"kubernetes.io/projected/90deca17-6cae-4588-bb86-183b8816af0c-kube-api-access-7mds9\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.334571 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.334507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-tmp\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.334749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.334584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.334749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.334617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mds9\" (UniqueName: \"kubernetes.io/projected/90deca17-6cae-4588-bb86-183b8816af0c-kube-api-access-7mds9\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.334749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.334656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.334749 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.334686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-manifests\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.335094 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.335072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-manifests\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.337012 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.336992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90deca17-6cae-4588-bb86-183b8816af0c-tmp\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.337377 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.337353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-webhook-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.337415 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.337361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90deca17-6cae-4588-bb86-183b8816af0c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.351502 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.351468    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mds9\" (UniqueName: \"kubernetes.io/projected/90deca17-6cae-4588-bb86-183b8816af0c-kube-api-access-7mds9\") pod \"opendatahub-operator-controller-manager-54cf7dfc9c-stcvv\" (UID: \"90deca17-6cae-4588-bb86-183b8816af0c\") " pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.460150 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.460057    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:34.630615 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:34.630573    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"]
Jul 16 21:53:34.634285 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:53:34.634262    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90deca17_6cae_4588_bb86_183b8816af0c.slice/crio-6468baf339af38c8c6bd056d29c0344b808c9544f92af1b8efc0a0a36ff2fdee WatchSource:0}: Error finding container 6468baf339af38c8c6bd056d29c0344b808c9544f92af1b8efc0a0a36ff2fdee: Status 404 returned error can't find the container with id 6468baf339af38c8c6bd056d29c0344b808c9544f92af1b8efc0a0a36ff2fdee
Jul 16 21:53:35.435311 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:35.435276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv" event={"ID":"90deca17-6cae-4588-bb86-183b8816af0c","Type":"ContainerStarted","Data":"6468baf339af38c8c6bd056d29c0344b808c9544f92af1b8efc0a0a36ff2fdee"}
Jul 16 21:53:38.449823 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:38.449790    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv" event={"ID":"90deca17-6cae-4588-bb86-183b8816af0c","Type":"ContainerStarted","Data":"ce2c8ec65c912faa4d6231338e17a403c4840093cb27cebe568238d684a375d7"}
Jul 16 21:53:39.455197 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:39.455159    2568 generic.go:356] "Generic (PLEG): container finished" podID="90deca17-6cae-4588-bb86-183b8816af0c" containerID="ce2c8ec65c912faa4d6231338e17a403c4840093cb27cebe568238d684a375d7" exitCode=0
Jul 16 21:53:39.455665 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:39.455243    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv" event={"ID":"90deca17-6cae-4588-bb86-183b8816af0c","Type":"ContainerDied","Data":"ce2c8ec65c912faa4d6231338e17a403c4840093cb27cebe568238d684a375d7"}
Jul 16 21:53:40.461303 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:40.461264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv" event={"ID":"90deca17-6cae-4588-bb86-183b8816af0c","Type":"ContainerStarted","Data":"5777cbb1bd96bd0831fc8a306f42af65f1ae27213a620a39c1dbabfcd6db68fd"}
Jul 16 21:53:40.461791 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:40.461367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:40.494449 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:40.494400    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv" podStartSLOduration=1.968797628 podStartE2EDuration="6.494381822s" totalImagesPullingTime="3.497462073s" totalInitContainerRuntime="1.028122121s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:40.491885908 +0000 UTC m=+275.795983276" watchObservedRunningTime="2026-07-16 21:53:40.494381822 +0000 UTC m=+275.798479258"
Jul 16 21:53:51.467014 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:51.466976    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54cf7dfc9c-stcvv"
Jul 16 21:53:54.452834 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.452797    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmssl"]
Jul 16 21:53:54.462732 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.462707    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:54.472461 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.472441    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 21:53:54.472565 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.472493    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-f4hc5\""
Jul 16 21:53:54.490876 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.490836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmssl"]
Jul 16 21:53:54.609270 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.609237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfvm\" (UniqueName: \"kubernetes.io/projected/92607a4e-fc86-4516-aa9f-2672fb4a45c1-kube-api-access-ggfvm\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:54.609270 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.609270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:54.710109 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.710020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfvm\" (UniqueName: \"kubernetes.io/projected/92607a4e-fc86-4516-aa9f-2672fb4a45c1-kube-api-access-ggfvm\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:54.710109 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.710059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:54.710295 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:53:54.710193    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 21:53:54.710295 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:53:54.710256    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert podName:92607a4e-fc86-4516-aa9f-2672fb4a45c1 nodeName:}" failed. No retries permitted until 2026-07-16 21:53:55.21024062 +0000 UTC m=+290.514337964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert") pod "odh-model-controller-7998c67dc4-lmssl" (UID: "92607a4e-fc86-4516-aa9f-2672fb4a45c1") : secret "odh-model-controller-webhook-cert" not found
Jul 16 21:53:54.738703 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:54.738675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfvm\" (UniqueName: \"kubernetes.io/projected/92607a4e-fc86-4516-aa9f-2672fb4a45c1-kube-api-access-ggfvm\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:55.214643 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.214584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:55.217216 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.217189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92607a4e-fc86-4516-aa9f-2672fb4a45c1-cert\") pod \"odh-model-controller-7998c67dc4-lmssl\" (UID: \"92607a4e-fc86-4516-aa9f-2672fb4a45c1\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:55.372129 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.372094    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:55.523143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.523120    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmssl"]
Jul 16 21:53:55.525550 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:53:55.525504    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92607a4e_fc86_4516_aa9f_2672fb4a45c1.slice/crio-b374c71198da1d3f64aae2c67dacb120403f36b2e897f4efdc83994ac4ce6c34 WatchSource:0}: Error finding container b374c71198da1d3f64aae2c67dacb120403f36b2e897f4efdc83994ac4ce6c34: Status 404 returned error can't find the container with id b374c71198da1d3f64aae2c67dacb120403f36b2e897f4efdc83994ac4ce6c34
Jul 16 21:53:55.584272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.584236    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qfzbg"]
Jul 16 21:53:55.588464 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.588447    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:55.592618 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.592595    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 21:53:55.609300 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.609272    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qfzbg"]
Jul 16 21:53:55.719579 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.719544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:55.719758 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.719598    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5l79\" (UniqueName: \"kubernetes.io/projected/9496bf43-745d-479c-9e71-4fe302e6d462-kube-api-access-l5l79\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:55.820421 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.820330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:55.820421 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.820379    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5l79\" (UniqueName: \"kubernetes.io/projected/9496bf43-745d-479c-9e71-4fe302e6d462-kube-api-access-l5l79\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:55.820632 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:53:55.820488    2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 21:53:55.820632 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:53:55.820577    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs podName:9496bf43-745d-479c-9e71-4fe302e6d462 nodeName:}" failed. No retries permitted until 2026-07-16 21:53:56.320562158 +0000 UTC m=+291.624659503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs") pod "model-serving-api-54d89bd5fc-qfzbg" (UID: "9496bf43-745d-479c-9e71-4fe302e6d462") : secret "model-serving-api-tls" not found
Jul 16 21:53:55.832758 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:55.832727    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5l79\" (UniqueName: \"kubernetes.io/projected/9496bf43-745d-479c-9e71-4fe302e6d462-kube-api-access-l5l79\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:56.324256 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:56.324218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:56.326896 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:56.326873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496bf43-745d-479c-9e71-4fe302e6d462-tls-certs\") pod \"model-serving-api-54d89bd5fc-qfzbg\" (UID: \"9496bf43-745d-479c-9e71-4fe302e6d462\") " pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:56.499299 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:56.499250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:56.523995 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:56.523417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl" event={"ID":"92607a4e-fc86-4516-aa9f-2672fb4a45c1","Type":"ContainerStarted","Data":"b374c71198da1d3f64aae2c67dacb120403f36b2e897f4efdc83994ac4ce6c34"}
Jul 16 21:53:56.674140 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:56.673942    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qfzbg"]
Jul 16 21:53:56.677782 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:53:56.677751    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9496bf43_745d_479c_9e71_4fe302e6d462.slice/crio-6493496c6fcb3f2b676125e9d331c3d6eba48235c994ccec7cd681daced8f59c WatchSource:0}: Error finding container 6493496c6fcb3f2b676125e9d331c3d6eba48235c994ccec7cd681daced8f59c: Status 404 returned error can't find the container with id 6493496c6fcb3f2b676125e9d331c3d6eba48235c994ccec7cd681daced8f59c
Jul 16 21:53:57.529363 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.529306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg" event={"ID":"9496bf43-745d-479c-9e71-4fe302e6d462","Type":"ContainerStarted","Data":"6493496c6fcb3f2b676125e9d331c3d6eba48235c994ccec7cd681daced8f59c"}
Jul 16 21:53:57.970949 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.969950    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"]
Jul 16 21:53:57.977468 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.977440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:57.981140 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.981104    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 21:53:57.981292 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.981145    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 21:53:57.982588 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.982387    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 21:53:57.982588 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.982423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 21:53:57.982588 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.982444    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:53:57.982837 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.982638    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rd79w\""
Jul 16 21:53:57.990978 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:57.990951    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"]
Jul 16 21:53:58.140755 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.140722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.140946 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.140781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8427fcea-5c8b-45f7-983a-1afa62a0c282-manager-config\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.140946 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.140819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpps2\" (UniqueName: \"kubernetes.io/projected/8427fcea-5c8b-45f7-983a-1afa62a0c282-kube-api-access-tpps2\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.140946 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.140906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-metrics-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.242174 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.242065    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.242174 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.242134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8427fcea-5c8b-45f7-983a-1afa62a0c282-manager-config\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.242174 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.242170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpps2\" (UniqueName: \"kubernetes.io/projected/8427fcea-5c8b-45f7-983a-1afa62a0c282-kube-api-access-tpps2\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.242455 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.242214    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-metrics-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.243214 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.243182    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8427fcea-5c8b-45f7-983a-1afa62a0c282-manager-config\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.245234 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.245209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.245339 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.245233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8427fcea-5c8b-45f7-983a-1afa62a0c282-metrics-cert\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.253139 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.253083    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpps2\" (UniqueName: \"kubernetes.io/projected/8427fcea-5c8b-45f7-983a-1afa62a0c282-kube-api-access-tpps2\") pod \"lws-controller-manager-656bfb4b98-cn755\" (UID: \"8427fcea-5c8b-45f7-983a-1afa62a0c282\") " pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:58.289332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:58.289294    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:53:59.040920 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.040716    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"]
Jul 16 21:53:59.043451 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:53:59.043419    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8427fcea_5c8b_45f7_983a_1afa62a0c282.slice/crio-4aa23584e03eef2ebdacbc599a7d26f3e59b1a297894e8f148332dc8c6db36ab WatchSource:0}: Error finding container 4aa23584e03eef2ebdacbc599a7d26f3e59b1a297894e8f148332dc8c6db36ab: Status 404 returned error can't find the container with id 4aa23584e03eef2ebdacbc599a7d26f3e59b1a297894e8f148332dc8c6db36ab
Jul 16 21:53:59.543336 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.543280    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl" event={"ID":"92607a4e-fc86-4516-aa9f-2672fb4a45c1","Type":"ContainerStarted","Data":"e1d5403fe4b268bd698b79ff8d5c518306387c2c75b6821352aba785098dc923"}
Jul 16 21:53:59.543704 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.543681    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:53:59.545603 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.545571    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg" event={"ID":"9496bf43-745d-479c-9e71-4fe302e6d462","Type":"ContainerStarted","Data":"e845afacec6b9356d97be7e6bc57d77e26aabf3647211438dadfdddaeedae868"}
Jul 16 21:53:59.545734 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.545638    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:53:59.547388 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.547360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755" event={"ID":"8427fcea-5c8b-45f7-983a-1afa62a0c282","Type":"ContainerStarted","Data":"4aa23584e03eef2ebdacbc599a7d26f3e59b1a297894e8f148332dc8c6db36ab"}
Jul 16 21:53:59.567273 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.566074    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl" podStartSLOduration=2.193419121 podStartE2EDuration="5.566048205s" totalImagesPullingTime="3.372629084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:59.565544229 +0000 UTC m=+294.869641596" watchObservedRunningTime="2026-07-16 21:53:59.566048205 +0000 UTC m=+294.870145572"
Jul 16 21:53:59.588037 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.587620    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg" podStartSLOduration=2.365953839 podStartE2EDuration="4.587598999s" totalImagesPullingTime="2.22164516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:53:59.585840493 +0000 UTC m=+294.889937886" watchObservedRunningTime="2026-07-16 21:53:59.587598999 +0000 UTC m=+294.891696367"
Jul 16 21:53:59.952793 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.952759    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"]
Jul 16 21:53:59.956263 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.956240    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:53:59.957281 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.957252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/314708d5-b9a2-4562-a59c-276ff095e1b0-tmp\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:53:59.957412 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.957302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svx6s\" (UniqueName: \"kubernetes.io/projected/314708d5-b9a2-4562-a59c-276ff095e1b0-kube-api-access-svx6s\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:53:59.957412 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.957377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314708d5-b9a2-4562-a59c-276ff095e1b0-tls-certs\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:53:59.960751 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.960730    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 21:53:59.961029 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.961009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 21:53:59.961095 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.961009    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 21:53:59.961689 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.961673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 21:53:59.962056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.962040    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l5xts\""
Jul 16 21:53:59.975626 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:53:59.975600    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"]
Jul 16 21:54:00.058731 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.058695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/314708d5-b9a2-4562-a59c-276ff095e1b0-tmp\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.059272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.058754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svx6s\" (UniqueName: \"kubernetes.io/projected/314708d5-b9a2-4562-a59c-276ff095e1b0-kube-api-access-svx6s\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.059272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.058807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314708d5-b9a2-4562-a59c-276ff095e1b0-tls-certs\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.061514 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.061470    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/314708d5-b9a2-4562-a59c-276ff095e1b0-tmp\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.061684 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.061667    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314708d5-b9a2-4562-a59c-276ff095e1b0-tls-certs\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.068821 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.068787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svx6s\" (UniqueName: \"kubernetes.io/projected/314708d5-b9a2-4562-a59c-276ff095e1b0-kube-api-access-svx6s\") pod \"kube-auth-proxy-695b65bf64-6mrwh\" (UID: \"314708d5-b9a2-4562-a59c-276ff095e1b0\") " pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:00.269369 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:00.269285    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"
Jul 16 21:54:01.391031 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:54:01.391009    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314708d5_b9a2_4562_a59c_276ff095e1b0.slice/crio-c6a39506d0ab5c1dca543c6eb84094ce5f0ffe6801f60bbf0ba96e2c74c8939a WatchSource:0}: Error finding container c6a39506d0ab5c1dca543c6eb84094ce5f0ffe6801f60bbf0ba96e2c74c8939a: Status 404 returned error can't find the container with id c6a39506d0ab5c1dca543c6eb84094ce5f0ffe6801f60bbf0ba96e2c74c8939a
Jul 16 21:54:01.393844 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:01.393801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh"]
Jul 16 21:54:01.559463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:01.559364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755" event={"ID":"8427fcea-5c8b-45f7-983a-1afa62a0c282","Type":"ContainerStarted","Data":"4a571b768da80c79133e9a5b387536a3a16a50cf6560b8ec8e1f7cc2419cb6ff"}
Jul 16 21:54:01.559463 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:01.559427    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:54:01.560464 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:01.560442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh" event={"ID":"314708d5-b9a2-4562-a59c-276ff095e1b0","Type":"ContainerStarted","Data":"c6a39506d0ab5c1dca543c6eb84094ce5f0ffe6801f60bbf0ba96e2c74c8939a"}
Jul 16 21:54:01.582370 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:01.582318    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755" podStartSLOduration=2.377847508 podStartE2EDuration="4.582300099s" totalImagesPullingTime="2.204452591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:01.57994521 +0000 UTC m=+296.884042603" watchObservedRunningTime="2026-07-16 21:54:01.582300099 +0000 UTC m=+296.886397466"
Jul 16 21:54:03.574291 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:03.574260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh" event={"ID":"314708d5-b9a2-4562-a59c-276ff095e1b0","Type":"ContainerStarted","Data":"a0521da48ee44de045d427cedd99443b3259a9138d076b8270ab16291b1da70b"}
Jul 16 21:54:03.607056 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:03.607009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-695b65bf64-6mrwh" podStartSLOduration=2.494704656 podStartE2EDuration="4.606993815s" totalImagesPullingTime="2.112289159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:03.605626607 +0000 UTC m=+298.909723975" watchObservedRunningTime="2026-07-16 21:54:03.606993815 +0000 UTC m=+298.911091183"
Jul 16 21:54:05.082551 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:05.082500    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 21:54:08.779130 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.779093    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"]
Jul 16 21:54:08.782160 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.782144    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.800299 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.800276    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 21:54:08.801716 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.801699    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jrnr8\""
Jul 16 21:54:08.819480 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.819448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"]
Jul 16 21:54:08.831148 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831115    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831312 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bxd\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-kube-api-access-k4bxd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831312 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831312 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831474 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831365    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831474 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831474 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831610 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.831610 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.831561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.932932 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.932890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.932932 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.932931    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.932950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.932974    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bxd\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-kube-api-access-k4bxd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933183 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933577 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933397    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933577 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933698 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933610    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933745 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.933843 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.933823    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.935408 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.935389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.936066 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.936043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.946325 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.946303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bxd\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-kube-api-access-k4bxd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:08.947744 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:08.947722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b50c72cd-7ca0-458d-8b49-3ba481964ed3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lrddk\" (UID: \"b50c72cd-7ca0-458d-8b49-3ba481964ed3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:09.092489 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:09.092394    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:09.247272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:09.247237    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"]
Jul 16 21:54:09.252656 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:54:09.252629    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50c72cd_7ca0_458d_8b49_3ba481964ed3.slice/crio-00a49e6f78d0f6b88b181107d8a208eebf36ca021ef92e436cce09747abc27bd WatchSource:0}: Error finding container 00a49e6f78d0f6b88b181107d8a208eebf36ca021ef92e436cce09747abc27bd: Status 404 returned error can't find the container with id 00a49e6f78d0f6b88b181107d8a208eebf36ca021ef92e436cce09747abc27bd
Jul 16 21:54:09.254767 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:09.254750    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:54:09.601853 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:09.601814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk" event={"ID":"b50c72cd-7ca0-458d-8b49-3ba481964ed3","Type":"ContainerStarted","Data":"00a49e6f78d0f6b88b181107d8a208eebf36ca021ef92e436cce09747abc27bd"}
Jul 16 21:54:10.554896 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:10.554865    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lmssl"
Jul 16 21:54:10.557252 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:10.557229    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qfzbg"
Jul 16 21:54:11.664490 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:11.664449    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:54:11.664776 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:11.664556    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:54:11.664776 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:11.664594    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:54:12.567879 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:12.567853    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-656bfb4b98-cn755"
Jul 16 21:54:12.617697 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:12.617652    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk" event={"ID":"b50c72cd-7ca0-458d-8b49-3ba481964ed3","Type":"ContainerStarted","Data":"a18dad1c1bfbf634b916d1cb3c70794b6715d1cd37da8951d475de00212327c2"}
Jul 16 21:54:12.665801 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:12.665751    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk" podStartSLOduration=2.25645925 podStartE2EDuration="4.665731248s" totalImagesPullingTime="2.409271998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:54:12.659497979 +0000 UTC m=+307.963595345" watchObservedRunningTime="2026-07-16 21:54:12.665731248 +0000 UTC m=+307.969828697"
Jul 16 21:54:13.092862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:13.092821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:13.097802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:13.097778    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:13.622686 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:13.622657    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:54:13.623770 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:54:13.623753    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lrddk"
Jul 16 21:55:39.238588 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.238555    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"]
Jul 16 21:55:39.240898 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.240882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.245780 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.245753    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 21:55:39.245780 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.245769    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 21:55:39.245780 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.245759    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cbks6\""
Jul 16 21:55:39.246024 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.245795    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 21:55:39.248726 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.248709    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 21:55:39.278802 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.274777    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"]
Jul 16 21:55:39.329217 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.329175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.329393 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.329241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.329441 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.329428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszqz\" (UniqueName: \"kubernetes.io/projected/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-kube-api-access-qszqz\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.430880 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.430826    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszqz\" (UniqueName: \"kubernetes.io/projected/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-kube-api-access-qszqz\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.431076 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.430902    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.431076 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.430930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.431504 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.431483    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.433464 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.433446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.460090 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.460055    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszqz\" (UniqueName: \"kubernetes.io/projected/b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae-kube-api-access-qszqz\") pod \"kuadrant-console-plugin-66b5774985-tmqqb\" (UID: \"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.561510 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.561427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"
Jul 16 21:55:39.723060 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.723035    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb"]
Jul 16 21:55:39.725751 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:55:39.725719    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ab52f3_68b8_4b13_a1c7_0bcb7a394dae.slice/crio-7163e506accf9680c0d962db1d85c23f19bac3ca09b0722eac68d8daa0bdc469 WatchSource:0}: Error finding container 7163e506accf9680c0d962db1d85c23f19bac3ca09b0722eac68d8daa0bdc469: Status 404 returned error can't find the container with id 7163e506accf9680c0d962db1d85c23f19bac3ca09b0722eac68d8daa0bdc469
Jul 16 21:55:39.986402 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:39.986364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb" event={"ID":"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae","Type":"ContainerStarted","Data":"7163e506accf9680c0d962db1d85c23f19bac3ca09b0722eac68d8daa0bdc469"}
Jul 16 21:55:54.491226 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.490949    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5c7887f5-xhv8m"]
Jul 16 21:55:54.520094 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.520068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.531063 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.531035    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 21:55:54.531204 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.531079    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 21:55:54.532516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.532309    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 21:55:54.532516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.532388    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 21:55:54.532516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.532401    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 21:55:54.532516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.532429    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 21:55:54.532516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.532515    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 21:55:54.533928 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.533901    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-llxxv\""
Jul 16 21:55:54.539516 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.539476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 21:55:54.544719 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.544687    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c7887f5-xhv8m"]
Jul 16 21:55:54.583967 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.583929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.583984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-oauth-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.584013    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-trusted-ca-bundle\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.584040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-oauth-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.584069    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.584097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cjj5\" (UniqueName: \"kubernetes.io/projected/23081dcf-7e87-4f23-8e9e-74291ad8586d-kube-api-access-6cjj5\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.584168 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.584157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-service-ca\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685373 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685338    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685560 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685386    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-oauth-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685560 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685409    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-trusted-ca-bundle\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685560 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-oauth-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685560 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685560 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cjj5\" (UniqueName: \"kubernetes.io/projected/23081dcf-7e87-4f23-8e9e-74291ad8586d-kube-api-access-6cjj5\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.685916 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.685607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-service-ca\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.686329 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.686302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-oauth-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.686584 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.686560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-trusted-ca-bundle\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.686814 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.686796    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.686892 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.686811    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23081dcf-7e87-4f23-8e9e-74291ad8586d-service-ca\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.688680 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.688659    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-oauth-config\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.688764 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.688700    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23081dcf-7e87-4f23-8e9e-74291ad8586d-console-serving-cert\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.704083 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.704045    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cjj5\" (UniqueName: \"kubernetes.io/projected/23081dcf-7e87-4f23-8e9e-74291ad8586d-kube-api-access-6cjj5\") pod \"console-7f5c7887f5-xhv8m\" (UID: \"23081dcf-7e87-4f23-8e9e-74291ad8586d\") " pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:55:54.831214 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:55:54.831120    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:56:01.796250 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:01.796219    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5c7887f5-xhv8m"]
Jul 16 21:56:01.942634 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:56:01.942595    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23081dcf_7e87_4f23_8e9e_74291ad8586d.slice/crio-597da8eb89157d540bb7b3ffc43058069024fe39ab449360453b618ac950e25b WatchSource:0}: Error finding container 597da8eb89157d540bb7b3ffc43058069024fe39ab449360453b618ac950e25b: Status 404 returned error can't find the container with id 597da8eb89157d540bb7b3ffc43058069024fe39ab449360453b618ac950e25b
Jul 16 21:56:02.098143 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:02.098111    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c7887f5-xhv8m" event={"ID":"23081dcf-7e87-4f23-8e9e-74291ad8586d","Type":"ContainerStarted","Data":"7a8f7737dda19498b63416af0726cd3ff09108c7d1cec840b3e13b23d494b3c2"}
Jul 16 21:56:02.098279 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:02.098162    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5c7887f5-xhv8m" event={"ID":"23081dcf-7e87-4f23-8e9e-74291ad8586d","Type":"ContainerStarted","Data":"597da8eb89157d540bb7b3ffc43058069024fe39ab449360453b618ac950e25b"}
Jul 16 21:56:03.104365 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:03.104329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb" event={"ID":"b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae","Type":"ContainerStarted","Data":"8b432284774e14ea518c58df795fbdf79be87941fe94241abb196f76dd7af892"}
Jul 16 21:56:03.152988 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:03.152936    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tmqqb" podStartSLOduration=1.8761542919999998 podStartE2EDuration="24.152918883s" totalImagesPullingTime="22.276764591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:03.151994042 +0000 UTC m=+418.456091423" watchObservedRunningTime="2026-07-16 21:56:03.152918883 +0000 UTC m=+418.457016250"
Jul 16 21:56:03.153670 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:03.153645    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5c7887f5-xhv8m" podStartSLOduration=9.153636433 podStartE2EDuration="9.153636433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:55:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:02.152858717 +0000 UTC m=+417.456956083" watchObservedRunningTime="2026-07-16 21:56:03.153636433 +0000 UTC m=+418.457733799"
Jul 16 21:56:04.831409 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:04.831368    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:56:04.831929 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:04.831445    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:56:04.836242 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:04.836217    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:56:05.116709 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:05.116632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5c7887f5-xhv8m"
Jul 16 21:56:25.233628 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.233600    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"]
Jul 16 21:56:25.261639 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.261566    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"]
Jul 16 21:56:25.261785 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.261670    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.267612 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.267579    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lwctc\""
Jul 16 21:56:25.368439 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368439 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368470    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368662    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da83f182-6c16-4756-ad85-515254324c4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368695 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da83f182-6c16-4756-ad85-515254324c4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.368818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.368785    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntb64\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-kube-api-access-ntb64\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469607 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469607 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469666    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da83f182-6c16-4756-ad85-515254324c4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da83f182-6c16-4756-ad85-515254324c4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469799    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.469862 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntb64\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-kube-api-access-ntb64\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470159 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.469934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470213 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.470159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470315 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.470258    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470392 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.470294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470495 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.470480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.470762 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.470739    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da83f182-6c16-4756-ad85-515254324c4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.472185 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.472167    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da83f182-6c16-4756-ad85-515254324c4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.472389 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.472369    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da83f182-6c16-4756-ad85-515254324c4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.479023 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.479001    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.479407 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.479386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntb64\" (UniqueName: \"kubernetes.io/projected/da83f182-6c16-4756-ad85-515254324c4e-kube-api-access-ntb64\") pod \"maas-default-gateway-openshift-default-56654dcf7-2hnbz\" (UID: \"da83f182-6c16-4756-ad85-515254324c4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.572232 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.572136    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:25.726241 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.726210    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"]
Jul 16 21:56:25.730048 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:56:25.730023    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda83f182_6c16_4756_ad85_515254324c4e.slice/crio-6bdeb6df622c97101dfa381c72430f7377aaa146c323ff14099301cc08f767fa WatchSource:0}: Error finding container 6bdeb6df622c97101dfa381c72430f7377aaa146c323ff14099301cc08f767fa: Status 404 returned error can't find the container with id 6bdeb6df622c97101dfa381c72430f7377aaa146c323ff14099301cc08f767fa
Jul 16 21:56:25.732694 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.732663    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:56:25.732788 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.732728    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:56:25.732788 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:25.732760    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:56:26.205077 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:26.205041    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" event={"ID":"da83f182-6c16-4756-ad85-515254324c4e","Type":"ContainerStarted","Data":"e4269738d5d502736a68f36fad4738476129506ee8539fa752ccccf32ee4f0a9"}
Jul 16 21:56:26.205270 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:26.205092    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" event={"ID":"da83f182-6c16-4756-ad85-515254324c4e","Type":"ContainerStarted","Data":"6bdeb6df622c97101dfa381c72430f7377aaa146c323ff14099301cc08f767fa"}
Jul 16 21:56:26.231456 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:26.231398    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" podStartSLOduration=1.2313759 podStartE2EDuration="1.2313759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:26.23000866 +0000 UTC m=+441.534106026" watchObservedRunningTime="2026-07-16 21:56:26.2313759 +0000 UTC m=+441.535473271"
Jul 16 21:56:26.572668 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:26.572577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:26.577449 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:26.577425    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:27.213833 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:27.213800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:27.214964 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:27.214943    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:56:28.623613 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.623579    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:28.627173 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.627153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:28.634971 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.634947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tr874\""
Jul 16 21:56:28.636829 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.636805    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:28.697647 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.697607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4f2\" (UniqueName: \"kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2\") pod \"authorino-58cd955675-4qjk7\" (UID: \"35791534-54a9-4c36-8639-cc97f711c660\") " pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:28.798615 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.798574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4f2\" (UniqueName: \"kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2\") pod \"authorino-58cd955675-4qjk7\" (UID: \"35791534-54a9-4c36-8639-cc97f711c660\") " pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:28.809160 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.809133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4f2\" (UniqueName: \"kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2\") pod \"authorino-58cd955675-4qjk7\" (UID: \"35791534-54a9-4c36-8639-cc97f711c660\") " pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:28.936548 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:28.936485    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:29.074329 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:29.074298    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:29.078120 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:56:29.078089    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35791534_54a9_4c36_8639_cc97f711c660.slice/crio-8d07964e724d37fc50b431791c0ec7d98a75339e9642f73db45196068be6bc26 WatchSource:0}: Error finding container 8d07964e724d37fc50b431791c0ec7d98a75339e9642f73db45196068be6bc26: Status 404 returned error can't find the container with id 8d07964e724d37fc50b431791c0ec7d98a75339e9642f73db45196068be6bc26
Jul 16 21:56:29.223136 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:29.223047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qjk7" event={"ID":"35791534-54a9-4c36-8639-cc97f711c660","Type":"ContainerStarted","Data":"8d07964e724d37fc50b431791c0ec7d98a75339e9642f73db45196068be6bc26"}
Jul 16 21:56:33.245513 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:33.245414    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qjk7" event={"ID":"35791534-54a9-4c36-8639-cc97f711c660","Type":"ContainerStarted","Data":"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"}
Jul 16 21:56:33.275197 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:33.275145    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4qjk7" podStartSLOduration=1.450696416 podStartE2EDuration="5.275127678s" totalImagesPullingTime="3.824431262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:56:33.273860233 +0000 UTC m=+448.577957600" watchObservedRunningTime="2026-07-16 21:56:33.275127678 +0000 UTC m=+448.579225046"
Jul 16 21:56:34.402927 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:34.402889    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:35.255137 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:35.255092    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4qjk7" podUID="35791534-54a9-4c36-8639-cc97f711c660" containerName="authorino" containerID="cri-o://7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f" gracePeriod=30
Jul 16 21:56:35.508157 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:35.508089    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:35.558438 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:35.558404    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg4f2\" (UniqueName: \"kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2\") pod \"35791534-54a9-4c36-8639-cc97f711c660\" (UID: \"35791534-54a9-4c36-8639-cc97f711c660\") "
Jul 16 21:56:35.560705 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:35.560680    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2" (OuterVolumeSpecName: "kube-api-access-kg4f2") pod "35791534-54a9-4c36-8639-cc97f711c660" (UID: "35791534-54a9-4c36-8639-cc97f711c660"). InnerVolumeSpecName "kube-api-access-kg4f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:56:35.660065 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:35.660028    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg4f2\" (UniqueName: \"kubernetes.io/projected/35791534-54a9-4c36-8639-cc97f711c660-kube-api-access-kg4f2\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:56:36.260092 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.260062    2568 generic.go:356] "Generic (PLEG): container finished" podID="35791534-54a9-4c36-8639-cc97f711c660" containerID="7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f" exitCode=0
Jul 16 21:56:36.260266 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.260110    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qjk7"
Jul 16 21:56:36.260266 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.260127    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qjk7" event={"ID":"35791534-54a9-4c36-8639-cc97f711c660","Type":"ContainerDied","Data":"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"}
Jul 16 21:56:36.260266 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.260159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qjk7" event={"ID":"35791534-54a9-4c36-8639-cc97f711c660","Type":"ContainerDied","Data":"8d07964e724d37fc50b431791c0ec7d98a75339e9642f73db45196068be6bc26"}
Jul 16 21:56:36.260266 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.260177    2568 scope.go:117] "RemoveContainer" containerID="7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"
Jul 16 21:56:36.269180 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.269160    2568 scope.go:117] "RemoveContainer" containerID="7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"
Jul 16 21:56:36.269447 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:56:36.269425    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f\": container with ID starting with 7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f not found: ID does not exist" containerID="7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"
Jul 16 21:56:36.269500 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.269460    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f"} err="failed to get container status \"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f\": rpc error: code = NotFound desc = could not find container \"7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f\": container with ID starting with 7f7967c6b32b13c9cdc1ea6ea5efef85d858a899fc6b5f670fdbf0c0e5b54a7f not found: ID does not exist"
Jul 16 21:56:36.287386 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.287353    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:36.290187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:36.290165    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qjk7"]
Jul 16 21:56:37.232818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:56:37.232774    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35791534-54a9-4c36-8639-cc97f711c660" path="/var/lib/kubelet/pods/35791534-54a9-4c36-8639-cc97f711c660/volumes"
Jul 16 21:57:02.110748 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.110714    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sv57r"]
Jul 16 21:57:02.111187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.111047    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35791534-54a9-4c36-8639-cc97f711c660" containerName="authorino"
Jul 16 21:57:02.111187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.111057    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="35791534-54a9-4c36-8639-cc97f711c660" containerName="authorino"
Jul 16 21:57:02.111187 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.111112    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="35791534-54a9-4c36-8639-cc97f711c660" containerName="authorino"
Jul 16 21:57:02.120141 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.120111    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.123327 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.123310    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tr874\""
Jul 16 21:57:02.129184 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.129163    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sv57r"]
Jul 16 21:57:02.303591 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.303511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbnnf\" (UniqueName: \"kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf\") pod \"authorino-5d4b67c446-sv57r\" (UID: \"eda0a70b-d911-49a8-93c9-1d75251da247\") " pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.356906 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.356878    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sv57r"]
Jul 16 21:57:02.357163 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:57:02.357141    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zbnnf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-sv57r" podUID="eda0a70b-d911-49a8-93c9-1d75251da247"
Jul 16 21:57:02.377302 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.377230    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.384048 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.384027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.404166 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.404131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbnnf\" (UniqueName: \"kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf\") pod \"authorino-5d4b67c446-sv57r\" (UID: \"eda0a70b-d911-49a8-93c9-1d75251da247\") " pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.404836 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.404817    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75dd548478-sg5bn"]
Jul 16 21:57:02.408170 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.408155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:02.417312 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.417289    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75dd548478-sg5bn"]
Jul 16 21:57:02.419649 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.419627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbnnf\" (UniqueName: \"kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf\") pod \"authorino-5d4b67c446-sv57r\" (UID: \"eda0a70b-d911-49a8-93c9-1d75251da247\") " pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:02.504903 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.504864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqsbm\" (UniqueName: \"kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm\") pod \"authorino-75dd548478-sg5bn\" (UID: \"23ee3743-77e8-4302-8c3d-da6f2712911c\") " pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:02.556755 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.556723    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75dd548478-sg5bn"]
Jul 16 21:57:02.557009 ip-10-0-141-223 kubenswrapper[2568]: E0716 21:57:02.556991    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mqsbm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-75dd548478-sg5bn" podUID="23ee3743-77e8-4302-8c3d-da6f2712911c"
Jul 16 21:57:02.602678 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.602644    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 21:57:02.605257 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.605229    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbnnf\" (UniqueName: \"kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf\") pod \"eda0a70b-d911-49a8-93c9-1d75251da247\" (UID: \"eda0a70b-d911-49a8-93c9-1d75251da247\") "
Jul 16 21:57:02.605422 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.605402    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqsbm\" (UniqueName: \"kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm\") pod \"authorino-75dd548478-sg5bn\" (UID: \"23ee3743-77e8-4302-8c3d-da6f2712911c\") " pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:02.606000 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.605980    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.607467 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.607441    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf" (OuterVolumeSpecName: "kube-api-access-zbnnf") pod "eda0a70b-d911-49a8-93c9-1d75251da247" (UID: "eda0a70b-d911-49a8-93c9-1d75251da247"). InnerVolumeSpecName "kube-api-access-zbnnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:57:02.609410 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.609393    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 21:57:02.615559 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.615513    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqsbm\" (UniqueName: \"kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm\") pod \"authorino-75dd548478-sg5bn\" (UID: \"23ee3743-77e8-4302-8c3d-da6f2712911c\") " pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:02.620409 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.620388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 21:57:02.706875 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.706836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629qb\" (UniqueName: \"kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.707045 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.706917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.707045 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.707026    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbnnf\" (UniqueName: \"kubernetes.io/projected/eda0a70b-d911-49a8-93c9-1d75251da247-kube-api-access-zbnnf\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:57:02.808258 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.808226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629qb\" (UniqueName: \"kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.808405 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.808307    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.810923 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.810899    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.821041 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.821017    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-629qb\" (UniqueName: \"kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb\") pod \"authorino-588978bdc4-7z8jd\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") " pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:02.929456 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:02.929409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 21:57:03.074198 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.074170    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 21:57:03.075816 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:57:03.075793    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6acf1a35_96f6_4ac3_b3a6_1dfa79955478.slice/crio-984f80478e3c154089ff5e9d27907b72ab4ea7bebdd1aaae9968fec700f909c2 WatchSource:0}: Error finding container 984f80478e3c154089ff5e9d27907b72ab4ea7bebdd1aaae9968fec700f909c2: Status 404 returned error can't find the container with id 984f80478e3c154089ff5e9d27907b72ab4ea7bebdd1aaae9968fec700f909c2
Jul 16 21:57:03.383022 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.382989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588978bdc4-7z8jd" event={"ID":"6acf1a35-96f6-4ac3-b3a6-1dfa79955478","Type":"ContainerStarted","Data":"984f80478e3c154089ff5e9d27907b72ab4ea7bebdd1aaae9968fec700f909c2"}
Jul 16 21:57:03.383022 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.383026    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:03.383466 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.383053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sv57r"
Jul 16 21:57:03.390638 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.390617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:03.436288 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.436259    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sv57r"]
Jul 16 21:57:03.443908 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.443882    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sv57r"]
Jul 16 21:57:03.515164 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.515139    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqsbm\" (UniqueName: \"kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm\") pod \"23ee3743-77e8-4302-8c3d-da6f2712911c\" (UID: \"23ee3743-77e8-4302-8c3d-da6f2712911c\") "
Jul 16 21:57:03.517199 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.517172    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm" (OuterVolumeSpecName: "kube-api-access-mqsbm") pod "23ee3743-77e8-4302-8c3d-da6f2712911c" (UID: "23ee3743-77e8-4302-8c3d-da6f2712911c"). InnerVolumeSpecName "kube-api-access-mqsbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:57:03.615883 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:03.615852    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqsbm\" (UniqueName: \"kubernetes.io/projected/23ee3743-77e8-4302-8c3d-da6f2712911c-kube-api-access-mqsbm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 21:57:04.388917 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:04.388881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588978bdc4-7z8jd" event={"ID":"6acf1a35-96f6-4ac3-b3a6-1dfa79955478","Type":"ContainerStarted","Data":"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"}
Jul 16 21:57:04.388917 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:04.388887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75dd548478-sg5bn"
Jul 16 21:57:04.407432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:04.407385    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-588978bdc4-7z8jd" podStartSLOduration=2.074508405 podStartE2EDuration="2.407367776s" totalImagesPullingTime="332.859371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:04.406429151 +0000 UTC m=+479.710526520" watchObservedRunningTime="2026-07-16 21:57:04.407367776 +0000 UTC m=+479.711465142"
Jul 16 21:57:04.434483 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:04.434452    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75dd548478-sg5bn"]
Jul 16 21:57:04.445826 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:04.445791    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75dd548478-sg5bn"]
Jul 16 21:57:05.233471 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:05.233436    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ee3743-77e8-4302-8c3d-da6f2712911c" path="/var/lib/kubelet/pods/23ee3743-77e8-4302-8c3d-da6f2712911c/volumes"
Jul 16 21:57:05.233797 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:05.233777    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda0a70b-d911-49a8-93c9-1d75251da247" path="/var/lib/kubelet/pods/eda0a70b-d911-49a8-93c9-1d75251da247/volumes"
Jul 16 21:57:53.624835 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.624801    2568 generic.go:356] "Generic (PLEG): container finished" podID="da83f182-6c16-4756-ad85-515254324c4e" containerID="e4269738d5d502736a68f36fad4738476129506ee8539fa752ccccf32ee4f0a9" exitCode=0
Jul 16 21:57:53.625222 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.624859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" event={"ID":"da83f182-6c16-4756-ad85-515254324c4e","Type":"ContainerDied","Data":"e4269738d5d502736a68f36fad4738476129506ee8539fa752ccccf32ee4f0a9"}
Jul 16 21:57:53.625261 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.625253    2568 scope.go:117] "RemoveContainer" containerID="e4269738d5d502736a68f36fad4738476129506ee8539fa752ccccf32ee4f0a9"
Jul 16 21:57:53.626332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.626302    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:57:53.626405 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.626388    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:57:53.626487 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:53.626437    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 21:57:54.631890 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:54.631860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" event={"ID":"da83f182-6c16-4756-ad85-515254324c4e","Type":"ContainerStarted","Data":"1b74f297bbcc3bfbd881df13f34ec76f1cda8ec0c80700c47a159b32096e3fbc"}
Jul 16 21:57:55.572698 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:55.572602    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:57:55.574059 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:55.574021    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2hnbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 16 21:57:55.574200 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:55.574102    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" podUID="da83f182-6c16-4756-ad85-515254324c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 21:57:56.573432 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:56.573390    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2hnbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 16 21:57:56.573931 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:56.573462    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" podUID="da83f182-6c16-4756-ad85-515254324c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 21:57:57.214222 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:57.214170    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:57:57.572974 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:57.572867    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2hnbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 16 21:57:57.572974 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:57.572943    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" podUID="da83f182-6c16-4756-ad85-515254324c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 21:57:58.572853 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:58.572814    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-2hnbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Jul 16 21:57:58.573455 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:58.573421    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz" podUID="da83f182-6c16-4756-ad85-515254324c4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Jul 16 21:57:59.576738 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:59.576706    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:57:59.577773 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:57:59.577750    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-2hnbz"
Jul 16 21:58:17.466717 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.466676    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"]
Jul 16 21:58:17.469507 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.469483    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.473927 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.473889    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 21:58:17.474119 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.473937    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khxnq\""
Jul 16 21:58:17.474189 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.474140    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 21:58:17.474277 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.474190    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 21:58:17.491239 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.491204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"]
Jul 16 21:58:17.592070 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.592298 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.592298 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55bp\" (UniqueName: \"kubernetes.io/projected/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-kube-api-access-j55bp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.592298 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.592298 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592248    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.592505 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.592324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693407 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j55bp\" (UniqueName: \"kubernetes.io/projected/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-kube-api-access-j55bp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693632 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693558    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693918 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.693971 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.694011 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.693968    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.695939 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.695916    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.696165 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.696143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.703352 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.703329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55bp\" (UniqueName: \"kubernetes.io/projected/42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8-kube-api-access-j55bp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8ch6d\" (UID: \"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.785332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.785239    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:17.920922 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:17.920800    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"]
Jul 16 21:58:17.923086 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:58:17.923060    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b2120d_14c6_48a0_b5a8_6ac9dc06cbc8.slice/crio-537cf3b3a932d21dc18b58f956ff099aa7ebfbca6e3f5f9b905672c8ab74a996 WatchSource:0}: Error finding container 537cf3b3a932d21dc18b58f956ff099aa7ebfbca6e3f5f9b905672c8ab74a996: Status 404 returned error can't find the container with id 537cf3b3a932d21dc18b58f956ff099aa7ebfbca6e3f5f9b905672c8ab74a996
Jul 16 21:58:18.742518 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:18.742470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d" event={"ID":"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8","Type":"ContainerStarted","Data":"537cf3b3a932d21dc18b58f956ff099aa7ebfbca6e3f5f9b905672c8ab74a996"}
Jul 16 21:58:19.749303 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:19.749262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d" event={"ID":"42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8","Type":"ContainerStarted","Data":"07b20b1344c8bcf1718e309954033b7de6f34e434a2b782d076b2005e026f3d2"}
Jul 16 21:58:19.769487 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:19.769433    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d" podStartSLOduration=1.721989751 podStartE2EDuration="2.769415624s" totalImagesPullingTime="1.047425873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:19.766776319 +0000 UTC m=+555.070873687" watchObservedRunningTime="2026-07-16 21:58:19.769415624 +0000 UTC m=+555.073512991"
Jul 16 21:58:27.786304 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:27.786272    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:27.786817 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:27.786373    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:27.799933 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:27.799906    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:28.801193 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:28.801162    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8ch6d"
Jul 16 21:58:53.789370 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.789335    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"]
Jul 16 21:58:53.795174 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.795151    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.797941 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.797920    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 21:58:53.801697 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.801674    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"]
Jul 16 21:58:53.838009 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.837965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgdkv\" (UniqueName: \"kubernetes.io/projected/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-kube-api-access-rgdkv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.838009 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.838016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.838216 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.838049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.838216 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.838070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.838216 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.838130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.838216 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.838171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.938985 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.938949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgdkv\" (UniqueName: \"kubernetes.io/projected/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-kube-api-access-rgdkv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939157 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.938995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939157 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939084    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939157 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939128    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939273 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939273 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939413 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939393    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939476 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.939571 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.939505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.941696 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.941674    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.941953 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.941933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:53.948271 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:53.948244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgdkv\" (UniqueName: \"kubernetes.io/projected/b36eda75-0b1b-4e96-99ac-ce821ba81bd1-kube-api-access-rgdkv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sp24w\" (UID: \"b36eda75-0b1b-4e96-99ac-ce821ba81bd1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:54.105914 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:54.105823    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:58:54.243788 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:54.243762    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"]
Jul 16 21:58:54.245838 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:58:54.245808    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36eda75_0b1b_4e96_99ac_ce821ba81bd1.slice/crio-c527f56e4da21c751b5c25b8dcf64008824b8189660de1ce6d73fe6c3cdfa93d WatchSource:0}: Error finding container c527f56e4da21c751b5c25b8dcf64008824b8189660de1ce6d73fe6c3cdfa93d: Status 404 returned error can't find the container with id c527f56e4da21c751b5c25b8dcf64008824b8189660de1ce6d73fe6c3cdfa93d
Jul 16 21:58:54.912439 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:54.912402    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w" event={"ID":"b36eda75-0b1b-4e96-99ac-ce821ba81bd1","Type":"ContainerStarted","Data":"53e960e967e81fa43ecb144429051d8c7d7053b549fc628ddfaba6bbb9f27a5b"}
Jul 16 21:58:54.912845 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:54.912484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w" event={"ID":"b36eda75-0b1b-4e96-99ac-ce821ba81bd1","Type":"ContainerStarted","Data":"c527f56e4da21c751b5c25b8dcf64008824b8189660de1ce6d73fe6c3cdfa93d"}
Jul 16 21:58:54.931568 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:58:54.931490    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w" podStartSLOduration=1.719904012 podStartE2EDuration="1.931471676s" totalImagesPullingTime="211.567664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:54.929019396 +0000 UTC m=+590.233116762" watchObservedRunningTime="2026-07-16 21:58:54.931471676 +0000 UTC m=+590.235569042"
Jul 16 21:59:04.106881 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:04.106843    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:59:04.107348 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:04.106952    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:59:04.119725 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:04.119696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:59:04.967332 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:04.967304    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sp24w"
Jul 16 21:59:08.387979 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.387949    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"]
Jul 16 21:59:08.391366 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.391349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.394310 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.394288    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 21:59:08.399921 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.399893    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"]
Jul 16 21:59:08.474652 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474620    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.474818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.474818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz79\" (UniqueName: \"kubernetes.io/projected/bf77e730-a881-4774-8770-76536274bc7a-kube-api-access-gnz79\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.474818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf77e730-a881-4774-8770-76536274bc7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.474818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.474818 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.474787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.576226 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.576226 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576272    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576315    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz79\" (UniqueName: \"kubernetes.io/projected/bf77e730-a881-4774-8770-76536274bc7a-kube-api-access-gnz79\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576369    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf77e730-a881-4774-8770-76536274bc7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.576712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.577025    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.577272 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.577142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.579331 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.579307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf77e730-a881-4774-8770-76536274bc7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.579439 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.579396    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf77e730-a881-4774-8770-76536274bc7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.585209 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.585182    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz79\" (UniqueName: \"kubernetes.io/projected/bf77e730-a881-4774-8770-76536274bc7a-kube-api-access-gnz79\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9\" (UID: \"bf77e730-a881-4774-8770-76536274bc7a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.701559 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.701445    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:08.837014 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.836982    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"]
Jul 16 21:59:08.838483 ip-10-0-141-223 kubenswrapper[2568]: W0716 21:59:08.838459    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf77e730_a881_4774_8770_76536274bc7a.slice/crio-890d8d69edbe0c39b475dc97ee157b4ea8111919d994dafeeac772e28dd616ac WatchSource:0}: Error finding container 890d8d69edbe0c39b475dc97ee157b4ea8111919d994dafeeac772e28dd616ac: Status 404 returned error can't find the container with id 890d8d69edbe0c39b475dc97ee157b4ea8111919d994dafeeac772e28dd616ac
Jul 16 21:59:08.974581 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:08.974463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9" event={"ID":"bf77e730-a881-4774-8770-76536274bc7a","Type":"ContainerStarted","Data":"890d8d69edbe0c39b475dc97ee157b4ea8111919d994dafeeac772e28dd616ac"}
Jul 16 21:59:09.981330 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:09.981290    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9" event={"ID":"bf77e730-a881-4774-8770-76536274bc7a","Type":"ContainerStarted","Data":"925c10dc15ac60a386741cff7f028bcf8bbf0085ee528b10e02e486a341da080"}
Jul 16 21:59:10.002736 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:10.002680    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9" podStartSLOduration=1.811581436 podStartE2EDuration="2.002664335s" totalImagesPullingTime="191.082899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:59:10.000438766 +0000 UTC m=+605.304536154" watchObservedRunningTime="2026-07-16 21:59:10.002664335 +0000 UTC m=+605.306761700"
Jul 16 21:59:18.702062 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:18.702018    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:18.702593 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:18.702079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:18.714880 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:18.714855    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 21:59:19.037393 ip-10-0-141-223 kubenswrapper[2568]: I0716 21:59:19.037313    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9"
Jul 16 22:00:09.493766 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.493707    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 22:00:09.494296 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.493973    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-588978bdc4-7z8jd" podUID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" containerName="authorino" containerID="cri-o://e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c" gracePeriod=30
Jul 16 22:00:09.761705 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.761681    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 22:00:09.870741 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.870703    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-629qb\" (UniqueName: \"kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb\") pod \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") "
Jul 16 22:00:09.870938 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.870765    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert\") pod \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\" (UID: \"6acf1a35-96f6-4ac3-b3a6-1dfa79955478\") "
Jul 16 22:00:09.872962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.872926    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb" (OuterVolumeSpecName: "kube-api-access-629qb") pod "6acf1a35-96f6-4ac3-b3a6-1dfa79955478" (UID: "6acf1a35-96f6-4ac3-b3a6-1dfa79955478"). InnerVolumeSpecName "kube-api-access-629qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:00:09.881731 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.881698    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6acf1a35-96f6-4ac3-b3a6-1dfa79955478" (UID: "6acf1a35-96f6-4ac3-b3a6-1dfa79955478"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:00:09.971450 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.971413    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-629qb\" (UniqueName: \"kubernetes.io/projected/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-kube-api-access-629qb\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:00:09.971450 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:09.971445    2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6acf1a35-96f6-4ac3-b3a6-1dfa79955478-tls-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:00:10.256895 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.256863    2568 generic.go:356] "Generic (PLEG): container finished" podID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" containerID="e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c" exitCode=0
Jul 16 22:00:10.257084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.256909    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588978bdc4-7z8jd"
Jul 16 22:00:10.257084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.256951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588978bdc4-7z8jd" event={"ID":"6acf1a35-96f6-4ac3-b3a6-1dfa79955478","Type":"ContainerDied","Data":"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"}
Jul 16 22:00:10.257084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.256994    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588978bdc4-7z8jd" event={"ID":"6acf1a35-96f6-4ac3-b3a6-1dfa79955478","Type":"ContainerDied","Data":"984f80478e3c154089ff5e9d27907b72ab4ea7bebdd1aaae9968fec700f909c2"}
Jul 16 22:00:10.257084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.257015    2568 scope.go:117] "RemoveContainer" containerID="e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"
Jul 16 22:00:10.266865 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.266846    2568 scope.go:117] "RemoveContainer" containerID="e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"
Jul 16 22:00:10.267174 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:00:10.267154    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c\": container with ID starting with e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c not found: ID does not exist" containerID="e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"
Jul 16 22:00:10.267222 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.267186    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c"} err="failed to get container status \"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c\": rpc error: code = NotFound desc = could not find container \"e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c\": container with ID starting with e67200ec2aad2e89d7395600cbd5798202a2695b1e7dde4ca04119e547e6a50c not found: ID does not exist"
Jul 16 22:00:10.280036 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.280006    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 22:00:10.284315 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:10.284293    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-588978bdc4-7z8jd"]
Jul 16 22:00:11.233310 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:00:11.233281    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" path="/var/lib/kubelet/pods/6acf1a35-96f6-4ac3-b3a6-1dfa79955478/volumes"
Jul 16 22:14:42.864088 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.864052    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:14:42.866503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.864456    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" containerName="authorino"
Jul 16 22:14:42.866503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.864469    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" containerName="authorino"
Jul 16 22:14:42.866503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.864561    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6acf1a35-96f6-4ac3-b3a6-1dfa79955478" containerName="authorino"
Jul 16 22:14:42.867475 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.867457    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.871107 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.871086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d3f2b144-openshift-default-dockercfg-hmkbs\""
Jul 16 22:14:42.917733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.917702    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:14:42.944849 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.944813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.944853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.944884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.944951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.944977    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.945006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.945023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.945098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:42.945238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:42.945203    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhhtp\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.052623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.052573    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.052801 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.052648    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.052801 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.052715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.052941 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.052917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053004 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.052987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053069 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053125 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053175 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053151    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhhtp\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053221 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053221 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053408 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053488 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053419    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053586 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.053638 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.053602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.055308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.055280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.055937 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.055914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.072756 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.072729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhhtp\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.079331 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.079307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token\") pod \"e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") " pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.177751 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.177710    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:43.380047 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.380006    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:14:43.407078 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:14:43.407052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ca781a_c5e8_4aba_84c8_46f179313072.slice/crio-6b12eaf2f96455b1669c2805ab2dd3ceba188c50f04ac7cf09b0e851113ee149 WatchSource:0}: Error finding container 6b12eaf2f96455b1669c2805ab2dd3ceba188c50f04ac7cf09b0e851113ee149: Status 404 returned error can't find the container with id 6b12eaf2f96455b1669c2805ab2dd3ceba188c50f04ac7cf09b0e851113ee149
Jul 16 22:14:43.409140 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.409109    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:14:43.409219 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.409180    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:14:43.409219 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:43.409209    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:14:44.255031 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:44.254993    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerStarted","Data":"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"}
Jul 16 22:14:44.255439 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:44.255050    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerStarted","Data":"6b12eaf2f96455b1669c2805ab2dd3ceba188c50f04ac7cf09b0e851113ee149"}
Jul 16 22:14:44.326233 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:44.326178    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podStartSLOduration=2.326159013 podStartE2EDuration="2.326159013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:44.325657612 +0000 UTC m=+1539.629754987" watchObservedRunningTime="2026-07-16 22:14:44.326159013 +0000 UTC m=+1539.630256380"
Jul 16 22:14:45.178396 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:45.178346    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:45.183815 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:45.183783    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:45.260184 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:45.260150    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:45.261238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:45.261221    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:14:59.330355 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.330319    2568 generic.go:356] "Generic (PLEG): container finished" podID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerID="aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6" exitCode=0
Jul 16 22:14:59.330917 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.330399    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerDied","Data":"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"}
Jul 16 22:14:59.330983 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.330935    2568 scope.go:117] "RemoveContainer" containerID="aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"
Jul 16 22:14:59.331993 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.331966    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:14:59.332094 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.332032    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:14:59.332094 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:14:59.332066    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:15:00.260617 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:00.260568    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:15:00.337272 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:00.337235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerStarted","Data":"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"}
Jul 16 22:15:01.178297 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:01.178255    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:15:01.179658 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:01.179625    2568 patch_prober.go:28] interesting pod/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 16 22:15:01.179805 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:01.179691    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 16 22:15:02.178581 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:02.178543    2568 patch_prober.go:28] interesting pod/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 16 22:15:02.179168 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:02.179136    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 16 22:15:03.183552 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:03.181948    2568 patch_prober.go:28] interesting pod/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 16 22:15:03.183552 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:03.182014    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 16 22:15:04.178652 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:04.178609    2568 patch_prober.go:28] interesting pod/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 16 22:15:04.178865 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:04.178680    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 16 22:15:05.182118 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:05.182090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:15:05.182492 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:05.182461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:15:05.183227 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:15:05.183211    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:17:49.326893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:49.326862    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:17:49.327368 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:49.327084    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" containerID="cri-o://09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d" gracePeriod=30
Jul 16 22:17:50.185291 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:50.185255    2568 patch_prober.go:28] interesting pod/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:17:50.185453 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:50.185348    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:17:54.586864 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.586832    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:17:54.632570 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.632471    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.632570 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.632516    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.632800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.632597    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.632800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.632617    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhhtp\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.632800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.632657    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633054    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633126    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket\") pod \"f0ca781a-c5e8-4aba-84c8-46f179313072\" (UID: \"f0ca781a-c5e8-4aba-84c8-46f179313072\") "
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633280    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633540    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633576    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633895    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633944    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633958    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0ca781a-c5e8-4aba-84c8-46f179313072-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633971    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.635446 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.633967    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:54.636325 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.636302    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:17:54.636325 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.636312    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:17:54.636437 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.636305    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:17:54.636767 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.636737    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp" (OuterVolumeSpecName: "kube-api-access-qhhtp") pod "f0ca781a-c5e8-4aba-84c8-46f179313072" (UID: "f0ca781a-c5e8-4aba-84c8-46f179313072"). InnerVolumeSpecName "kube-api-access-qhhtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:17:54.735013 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.734977    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhhtp\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-kube-api-access-qhhtp\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.735013 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.735009    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.735013 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.735020    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0ca781a-c5e8-4aba-84c8-46f179313072-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.735231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.735027    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:54.735231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:54.735035    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0ca781a-c5e8-4aba-84c8-46f179313072-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:17:55.169074 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.169040    2568 generic.go:356] "Generic (PLEG): container finished" podID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerID="09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d" exitCode=0
Jul 16 22:17:55.169240 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.169076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerDied","Data":"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"}
Jul 16 22:17:55.169240 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.169093    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"
Jul 16 22:17:55.169240 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.169131    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b" event={"ID":"f0ca781a-c5e8-4aba-84c8-46f179313072","Type":"ContainerDied","Data":"6b12eaf2f96455b1669c2805ab2dd3ceba188c50f04ac7cf09b0e851113ee149"}
Jul 16 22:17:55.169240 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.169152    2568 scope.go:117] "RemoveContainer" containerID="09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"
Jul 16 22:17:55.178443 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.178425    2568 scope.go:117] "RemoveContainer" containerID="aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"
Jul 16 22:17:55.186744 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.186727    2568 scope.go:117] "RemoveContainer" containerID="09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"
Jul 16 22:17:55.186992 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:17:55.186972    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d\": container with ID starting with 09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d not found: ID does not exist" containerID="09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"
Jul 16 22:17:55.187062 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.187000    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d"} err="failed to get container status \"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d\": rpc error: code = NotFound desc = could not find container \"09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d\": container with ID starting with 09139567bef40ddaddf327433928966d20d070bfd1e947cf903bd45c8127068d not found: ID does not exist"
Jul 16 22:17:55.187062 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.187017    2568 scope.go:117] "RemoveContainer" containerID="aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"
Jul 16 22:17:55.187270 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:17:55.187254    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6\": container with ID starting with aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6 not found: ID does not exist" containerID="aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"
Jul 16 22:17:55.187326 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.187276    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6"} err="failed to get container status \"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6\": rpc error: code = NotFound desc = could not find container \"aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6\": container with ID starting with aa908175116898a0cab1d5a429128d202f1251548126f66ee8c51b241e40b8d6 not found: ID does not exist"
Jul 16 22:17:55.197361 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.197332    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:17:55.198934 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.198916    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d3f2b144-openshift-default-6f96cd766c-2bm4b"]
Jul 16 22:17:55.233444 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:17:55.233418    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" path="/var/lib/kubelet/pods/f0ca781a-c5e8-4aba-84c8-46f179313072/volumes"
Jul 16 22:18:02.273465 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273432    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:18:02.273893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273833    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.273893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273850    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.273893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273870    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.273893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273878    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.274049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273987    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.274049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.273998    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ca781a-c5e8-4aba-84c8-46f179313072" containerName="istio-proxy"
Jul 16 22:18:02.278842 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.278825    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.281644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.281625    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-39074f9f-gw-openshift-default-dockercfg-jr59z\""
Jul 16 22:18:02.292457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.292430    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:18:02.306857 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.306829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vsdc\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.306985 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.306870    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.306985 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.306935    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.306985 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.306975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.307082 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.306998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.307082 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.307016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.307082 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.307043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.307082 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.307062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.307214 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.307094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408614 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vsdc\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408654    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408711    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408781    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.408817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409104 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409104 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409104 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.408898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.409266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.409339    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.409428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.409493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.409787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.409566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.411339 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.411308    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.411653 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.411634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.424858 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.424830    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vsdc\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.425258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.425232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token\") pod \"e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") " pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.589888 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.589791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:02.731707 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.731682    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:18:02.733621 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:18:02.733590    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963ed9f7_aac1_44fa_99dc_f2678bd4ca8c.slice/crio-9e098ea1275521bbb98bf4ba081aee707e1c9dc376250f2dc1949c7693f77d42 WatchSource:0}: Error finding container 9e098ea1275521bbb98bf4ba081aee707e1c9dc376250f2dc1949c7693f77d42: Status 404 returned error can't find the container with id 9e098ea1275521bbb98bf4ba081aee707e1c9dc376250f2dc1949c7693f77d42
Jul 16 22:18:02.735710 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.735680    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:02.735790 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.735743    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:02.735790 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:02.735772    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:03.207866 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:03.207833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerStarted","Data":"96748f0c48671ea0e8526db2d88141877afe9985148a32c2cf7227dd50269b38"}
Jul 16 22:18:03.208040 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:03.207884    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerStarted","Data":"9e098ea1275521bbb98bf4ba081aee707e1c9dc376250f2dc1949c7693f77d42"}
Jul 16 22:18:03.230773 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:03.230722    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podStartSLOduration=1.230704019 podStartE2EDuration="1.230704019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:03.229481087 +0000 UTC m=+1738.533578455" watchObservedRunningTime="2026-07-16 22:18:03.230704019 +0000 UTC m=+1738.534801388"
Jul 16 22:18:03.590497 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:03.590406    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:03.595961 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:03.595930    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:04.212540 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:04.212507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:04.213647 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:04.213625    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:15.262314 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.262284    2568 generic.go:356] "Generic (PLEG): container finished" podID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerID="96748f0c48671ea0e8526db2d88141877afe9985148a32c2cf7227dd50269b38" exitCode=0
Jul 16 22:18:15.262769 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.262355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerDied","Data":"96748f0c48671ea0e8526db2d88141877afe9985148a32c2cf7227dd50269b38"}
Jul 16 22:18:15.262859 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.262842    2568 scope.go:117] "RemoveContainer" containerID="96748f0c48671ea0e8526db2d88141877afe9985148a32c2cf7227dd50269b38"
Jul 16 22:18:15.264088 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.264058    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:15.264165 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.264148    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:15.264213 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:15.264196    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:18:16.268708 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:16.268671    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerStarted","Data":"88c2c989a11a0e7d77d9400d0d6fd5a1d7c10404d4f0ae51cd16b7b883a564bd"}
Jul 16 22:18:16.590255 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:16.590159    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:16.591570 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:16.591512    2568 patch_prober.go:28] interesting pod/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 16 22:18:16.591826 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:16.591796    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 16 22:18:17.591271 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:17.591220    2568 patch_prober.go:28] interesting pod/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 16 22:18:17.591810 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:17.591297    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 16 22:18:18.591252 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:18.591211    2568 patch_prober.go:28] interesting pod/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 16 22:18:18.591622 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:18.591584    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 16 22:18:19.213254 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:19.213218    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:19.590724 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:19.590627    2568 patch_prober.go:28] interesting pod/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 16 22:18:19.591443 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:19.591029    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 16 22:18:20.594136 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:20.594111    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:18:20.595268 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:18:20.595249    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:19:08.326075 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:08.326037    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:19:08.326590 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:08.326275    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy" containerID="cri-o://88c2c989a11a0e7d77d9400d0d6fd5a1d7c10404d4f0ae51cd16b7b883a564bd" gracePeriod=30
Jul 16 22:19:13.552486 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.552447    2568 generic.go:356] "Generic (PLEG): container finished" podID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerID="88c2c989a11a0e7d77d9400d0d6fd5a1d7c10404d4f0ae51cd16b7b883a564bd" exitCode=0
Jul 16 22:19:13.553000 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.552514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerDied","Data":"88c2c989a11a0e7d77d9400d0d6fd5a1d7c10404d4f0ae51cd16b7b883a564bd"}
Jul 16 22:19:13.553000 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.552594    2568 scope.go:117] "RemoveContainer" containerID="96748f0c48671ea0e8526db2d88141877afe9985148a32c2cf7227dd50269b38"
Jul 16 22:19:13.586270 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.586213    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:19:13.619354 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619319    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619354 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619421    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619571    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vsdc\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619620    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619661    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619683    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.619733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.619728    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert\") pod \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\" (UID: \"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c\") "
Jul 16 22:19:13.621084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.620208    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:13.621084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.620478    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:13.621084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.620478    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:19:13.621084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.620661    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:13.621084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.621044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:13.622201 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.622167    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:19:13.623188 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.623156    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc" (OuterVolumeSpecName: "kube-api-access-8vsdc") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "kube-api-access-8vsdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:13.623188 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.623171    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:13.623365 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.623163    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" (UID: "963ed9f7-aac1-44fa-99dc-f2678bd4ca8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:13.721407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721369    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vsdc\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-kube-api-access-8vsdc\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721400    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721410    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721418    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721725 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721427    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721725 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721435    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721725 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721442    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721725 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721450    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:13.721725 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:13.721458    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:19:14.558774 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:14.558743    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"
Jul 16 22:19:14.558774 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:14.558761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs" event={"ID":"963ed9f7-aac1-44fa-99dc-f2678bd4ca8c","Type":"ContainerDied","Data":"9e098ea1275521bbb98bf4ba081aee707e1c9dc376250f2dc1949c7693f77d42"}
Jul 16 22:19:14.559274 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:14.558844    2568 scope.go:117] "RemoveContainer" containerID="88c2c989a11a0e7d77d9400d0d6fd5a1d7c10404d4f0ae51cd16b7b883a564bd"
Jul 16 22:19:14.591803 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:14.591762    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:19:14.598442 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:14.598413    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-39074f9f-gw-openshift-default-846bf599cf-lm2bs"]
Jul 16 22:19:15.233066 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:15.233033    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" path="/var/lib/kubelet/pods/963ed9f7-aac1-44fa-99dc-f2678bd4ca8c/volumes"
Jul 16 22:19:23.728152 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728116    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728459    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728470    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728483    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728488    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728577    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.728649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.728587    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="963ed9f7-aac1-44fa-99dc-f2678bd4ca8c" containerName="istio-proxy"
Jul 16 22:19:23.733001 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.732978    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.738903 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.738883    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-23b64857-openshift-default-dockercfg-nlk5g\""
Jul 16 22:19:23.754514 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.754484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:19:23.813468 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4p8\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813582    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813867 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813867 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813867 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.813867 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.813829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914492 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914505    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914613    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4p8\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.914714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914668    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914718    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.914817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.915026    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915248 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.915114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915248 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.915157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915248 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.915231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.915883 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.915856    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.917073 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.917052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.917202 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.917186    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.940107 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.940068    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:23.940369 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:23.940347    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4p8\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8\") pod \"e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") " pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:24.043803 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.043708    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:24.210654 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:19:24.210624    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6771d5f0_7e8e_4913_a3be_0072591d8d02.slice/crio-c9dd1891833937c7b71cf29ed25d30413c8057849adab81fac6713b3a489954d WatchSource:0}: Error finding container c9dd1891833937c7b71cf29ed25d30413c8057849adab81fac6713b3a489954d: Status 404 returned error can't find the container with id c9dd1891833937c7b71cf29ed25d30413c8057849adab81fac6713b3a489954d
Jul 16 22:19:24.212952 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.212921    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:24.213063 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.213010    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:24.213063 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.213057    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:24.213420 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.213396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:19:24.610137 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.610103    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerStarted","Data":"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"}
Jul 16 22:19:24.610315 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.610158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerStarted","Data":"c9dd1891833937c7b71cf29ed25d30413c8057849adab81fac6713b3a489954d"}
Jul 16 22:19:24.658071 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:24.657868    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podStartSLOduration=1.657847296 podStartE2EDuration="1.657847296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:19:24.656947948 +0000 UTC m=+1819.961045315" watchObservedRunningTime="2026-07-16 22:19:24.657847296 +0000 UTC m=+1819.961944664"
Jul 16 22:19:25.044538 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:25.044494    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:25.049616 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:25.049588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:25.615252 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:25.615217    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:25.616318 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:25.616300    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:36.669205 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.669173    2568 generic.go:356] "Generic (PLEG): container finished" podID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerID="ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640" exitCode=0
Jul 16 22:19:36.669631 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.669249    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerDied","Data":"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"}
Jul 16 22:19:36.669708 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.669693    2568 scope.go:117] "RemoveContainer" containerID="ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"
Jul 16 22:19:36.670739 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.670710    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:36.670861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.670793    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:36.670861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:36.670844    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:19:37.679034 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:37.678989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerStarted","Data":"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"}
Jul 16 22:19:38.044233 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:38.044134    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:38.045432 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:38.045404    2568 patch_prober.go:28] interesting pod/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 16 22:19:38.045571 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:38.045458    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:19:39.044406 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:39.044374    2568 patch_prober.go:28] interesting pod/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 16 22:19:39.044783 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:39.044444    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:19:40.044616 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:40.044573    2568 patch_prober.go:28] interesting pod/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 16 22:19:40.045080 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:40.044635    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:19:40.615953 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:40.615913    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:41.044709 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:41.044677    2568 patch_prober.go:28] interesting pod/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 16 22:19:41.045145 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:41.044742    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 16 22:19:42.048627 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:42.048592    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:19:42.049550 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:19:42.049512    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:25:30.303907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:30.303821    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:25:30.304407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:30.304072    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy" containerID="cri-o://839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260" gracePeriod=30
Jul 16 22:25:35.565219 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.565189    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:25:35.623143 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623110    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623143 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623143    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623178    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4p8\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623308 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623301    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623553 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623370    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623553 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623395    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert\") pod \"6771d5f0-7e8e-4913-a3be-0072591d8d02\" (UID: \"6771d5f0-7e8e-4913-a3be-0072591d8d02\") "
Jul 16 22:25:35.623662 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623565    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:25:35.623662 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623604    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:25:35.623865 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623842    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.623933 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623876    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.623933 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.623852    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:25:35.624102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.624076    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:25:35.624579 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.624550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data" (OuterVolumeSpecName: "istio-data") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:25:35.625727 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.625704    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:25:35.625844 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.625830    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:25:35.626089 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.626075    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token" (OuterVolumeSpecName: "istio-token") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:35.626198 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.626178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8" (OuterVolumeSpecName: "kube-api-access-wj4p8") pod "6771d5f0-7e8e-4913-a3be-0072591d8d02" (UID: "6771d5f0-7e8e-4913-a3be-0072591d8d02"). InnerVolumeSpecName "kube-api-access-wj4p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:25:35.725102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725062    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725100    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725112    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725366 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725128    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4p8\" (UniqueName: \"kubernetes.io/projected/6771d5f0-7e8e-4913-a3be-0072591d8d02-kube-api-access-wj4p8\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725366 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725141    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725366 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725155    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6771d5f0-7e8e-4913-a3be-0072591d8d02-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:35.725366 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:35.725165    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6771d5f0-7e8e-4913-a3be-0072591d8d02-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:25:36.377079 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.377041    2568 generic.go:356] "Generic (PLEG): container finished" podID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerID="839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260" exitCode=0
Jul 16 22:25:36.377290 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.377091    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"
Jul 16 22:25:36.377290 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.377137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerDied","Data":"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"}
Jul 16 22:25:36.377290 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.377200    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2" event={"ID":"6771d5f0-7e8e-4913-a3be-0072591d8d02","Type":"ContainerDied","Data":"c9dd1891833937c7b71cf29ed25d30413c8057849adab81fac6713b3a489954d"}
Jul 16 22:25:36.377290 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.377232    2568 scope.go:117] "RemoveContainer" containerID="839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"
Jul 16 22:25:36.387047 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.387030    2568 scope.go:117] "RemoveContainer" containerID="ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"
Jul 16 22:25:36.394999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.394979    2568 scope.go:117] "RemoveContainer" containerID="839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"
Jul 16 22:25:36.395261 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:25:36.395242    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260\": container with ID starting with 839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260 not found: ID does not exist" containerID="839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"
Jul 16 22:25:36.395322 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.395268    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260"} err="failed to get container status \"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260\": rpc error: code = NotFound desc = could not find container \"839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260\": container with ID starting with 839e0abcd98ade0931166a28eba01361af046086b106f57b282a2511e98db260 not found: ID does not exist"
Jul 16 22:25:36.395322 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.395285    2568 scope.go:117] "RemoveContainer" containerID="ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"
Jul 16 22:25:36.395498 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:25:36.395481    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640\": container with ID starting with ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640 not found: ID does not exist" containerID="ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"
Jul 16 22:25:36.395575 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.395502    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640"} err="failed to get container status \"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640\": rpc error: code = NotFound desc = could not find container \"ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640\": container with ID starting with ee224ba780faffee5185306f10e5e90d3e2563be9b0e40d2cd5e3d3c6845f640 not found: ID does not exist"
Jul 16 22:25:36.401424 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.401398    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:25:36.405982 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:36.405958    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-23b64857-openshift-default-84db8cbb57-t8hx2"]
Jul 16 22:25:37.233874 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:37.233839    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" path="/var/lib/kubelet/pods/6771d5f0-7e8e-4913-a3be-0072591d8d02/volumes"
Jul 16 22:25:42.987274 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987241    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:25:42.987676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987638    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:25:42.987676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987651    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:25:42.987676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987666    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:25:42.987676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987671    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:25:42.987819 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.987730    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:25:42.989790 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.989773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:42.992826 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:42.992808    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f757c4eb-openshift-default-dockercfg-59h7p\""
Jul 16 22:25:43.010213 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.010179    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:25:43.103693 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103693 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m898\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103886    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.103962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.104186 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.103966    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.104186 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.104054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204545 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204721 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204721 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204593    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204721 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204721 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m898\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204889 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204769    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204889 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204845    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.204889 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204874    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205030 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205030 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205030 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.204952    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205292 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.205269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205341 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.205297    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.205837 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.205815    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.207150 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.207127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.207251 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.207173    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.214668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.214640    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m898\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.216419 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.216395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token\") pod \"e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") " pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.299682 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.299601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:43.447028 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.446994    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:25:43.450990 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:25:43.450964    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904d47b1_4264_496e_bb8e_02fe786366b4.slice/crio-21b345aaf04ee1c31484f8c35e2a896e9a9d394a04130a29080a85819bb751ba WatchSource:0}: Error finding container 21b345aaf04ee1c31484f8c35e2a896e9a9d394a04130a29080a85819bb751ba: Status 404 returned error can't find the container with id 21b345aaf04ee1c31484f8c35e2a896e9a9d394a04130a29080a85819bb751ba
Jul 16 22:25:43.453161 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.453133    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:43.453222 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.453201    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:43.453256 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:43.453247    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:44.418369 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:44.418330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerStarted","Data":"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"}
Jul 16 22:25:44.418781 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:44.418387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerStarted","Data":"21b345aaf04ee1c31484f8c35e2a896e9a9d394a04130a29080a85819bb751ba"}
Jul 16 22:25:45.300444 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:45.300401    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:45.305251 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:45.305221    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:45.333748 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:45.333688    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podStartSLOduration=3.333670301 podStartE2EDuration="3.333670301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:25:44.449291195 +0000 UTC m=+2199.753388563" watchObservedRunningTime="2026-07-16 22:25:45.333670301 +0000 UTC m=+2200.637767668"
Jul 16 22:25:45.423899 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:45.422884    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:45.424363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:45.424063    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:55.471003 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.470972    2568 generic.go:356] "Generic (PLEG): container finished" podID="904d47b1-4264-496e-bb8e-02fe786366b4" containerID="638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187" exitCode=0
Jul 16 22:25:55.471567 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.471051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerDied","Data":"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"}
Jul 16 22:25:55.471644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.471590    2568 scope.go:117] "RemoveContainer" containerID="638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"
Jul 16 22:25:55.472729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.472682    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:55.472811 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.472784    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:55.472848 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:55.472817    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:25:56.477539 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:56.477485    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerStarted","Data":"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"}
Jul 16 22:25:57.300384 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:57.300339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:25:57.301623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:57.301593    2568 patch_prober.go:28] interesting pod/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 16 22:25:57.301748 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:57.301660    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 16 22:25:58.300777 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:58.300722    2568 patch_prober.go:28] interesting pod/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 16 22:25:58.301288 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:58.300825    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 16 22:25:59.301027 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:59.300982    2568 patch_prober.go:28] interesting pod/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 16 22:25:59.301483 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:25:59.301065    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 16 22:26:00.300008 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:26:00.299961    2568 patch_prober.go:28] interesting pod/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 16 22:26:00.300226 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:26:00.300041    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 16 22:26:00.423477 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:26:00.423437    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:26:01.304503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:26:01.304470    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:26:01.305594 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:26:01.305572    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:28:48.678433 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:48.678396    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:28:48.679017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:48.678621    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy" containerID="cri-o://896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5" gracePeriod=30
Jul 16 22:28:53.928069 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:53.928038    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:28:54.084148 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084115    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084337 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084199    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084337 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084337 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084271    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084337 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084298    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084563 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084351    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084563 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084416    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084563 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084453    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084563 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084485    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m898\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898\") pod \"904d47b1-4264-496e-bb8e-02fe786366b4\" (UID: \"904d47b1-4264-496e-bb8e-02fe786366b4\") "
Jul 16 22:28:54.084767 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084564    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:28:54.084827 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084808    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:28:54.084885 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.084828    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.085427 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.085378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:28:54.085632 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.085609    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:28:54.085839 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.085809    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:28:54.088203 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.088165    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898" (OuterVolumeSpecName: "kube-api-access-2m898") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "kube-api-access-2m898". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:28:54.088306 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.088241    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:28:54.088370 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.088327    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:28:54.088686 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.088661    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "904d47b1-4264-496e-bb8e-02fe786366b4" (UID: "904d47b1-4264-496e-bb8e-02fe786366b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:28:54.185646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185607    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m898\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-kube-api-access-2m898\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185641    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185650    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185658    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/904d47b1-4264-496e-bb8e-02fe786366b4-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185902 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185666    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185902 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185674    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/904d47b1-4264-496e-bb8e-02fe786366b4-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185902 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185682    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/904d47b1-4264-496e-bb8e-02fe786366b4-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.185902 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.185691    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/904d47b1-4264-496e-bb8e-02fe786366b4-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:28:54.322971 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.322883    2568 generic.go:356] "Generic (PLEG): container finished" podID="904d47b1-4264-496e-bb8e-02fe786366b4" containerID="896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5" exitCode=0
Jul 16 22:28:54.322971 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.322929    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"
Jul 16 22:28:54.323167 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.322974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerDied","Data":"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"}
Jul 16 22:28:54.323167 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.323034    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm" event={"ID":"904d47b1-4264-496e-bb8e-02fe786366b4","Type":"ContainerDied","Data":"21b345aaf04ee1c31484f8c35e2a896e9a9d394a04130a29080a85819bb751ba"}
Jul 16 22:28:54.323167 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.323059    2568 scope.go:117] "RemoveContainer" containerID="896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"
Jul 16 22:28:54.332331 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.332314    2568 scope.go:117] "RemoveContainer" containerID="638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"
Jul 16 22:28:54.340386 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.340369    2568 scope.go:117] "RemoveContainer" containerID="896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"
Jul 16 22:28:54.340688 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:28:54.340664    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5\": container with ID starting with 896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5 not found: ID does not exist" containerID="896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"
Jul 16 22:28:54.340787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.340695    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5"} err="failed to get container status \"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5\": rpc error: code = NotFound desc = could not find container \"896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5\": container with ID starting with 896c1423fa228d7dd30860d767fa7ab554200d8f1215bf7ee9dfe0380f1b22e5 not found: ID does not exist"
Jul 16 22:28:54.340787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.340714    2568 scope.go:117] "RemoveContainer" containerID="638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"
Jul 16 22:28:54.340974 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:28:54.340957    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187\": container with ID starting with 638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187 not found: ID does not exist" containerID="638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"
Jul 16 22:28:54.341021 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.340977    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187"} err="failed to get container status \"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187\": rpc error: code = NotFound desc = could not find container \"638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187\": container with ID starting with 638cb976d8daf29c3370d09530ff4ca2b99d3e1cf2e890d650de92bb7c9c6187 not found: ID does not exist"
Jul 16 22:28:54.349304 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.349264    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:28:54.355246 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:54.355223    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f757c4eb-openshift-default-564dc7d86c-v47nm"]
Jul 16 22:28:55.234714 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:28:55.234683    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" path="/var/lib/kubelet/pods/904d47b1-4264-496e-bb8e-02fe786366b4/volumes"
Jul 16 22:30:43.913886 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.913845    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914219    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914230    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914239    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914244    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914305    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:30:43.914363 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.914316    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6771d5f0-7e8e-4913-a3be-0072591d8d02" containerName="istio-proxy"
Jul 16 22:30:43.917283 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.917258    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:43.920404 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.920385    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5d6c742e-openshift-default-dockercfg-44zzl\""
Jul 16 22:30:43.933232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:43.933203    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:30:44.041956 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.041915    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042132 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.041975    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042132 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042016    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042132 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042132 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gqpd\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.042345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.042281    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143042 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.142997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143042 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143287 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143287 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143397 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqpd\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143397 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143328    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143397 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143615 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143615 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143485    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143741 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143741 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143681    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143877 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143877 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.143877 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.143835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.145863 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.145840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.146164 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.146143    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.152238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.152206    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqpd\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.152820 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.152799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token\") pod \"e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") " pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.227364 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.227270    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:44.375123 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.375095    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:30:44.377275 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:30:44.377247    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb5fb04_ec76_424d_a480_be0e62438ddf.slice/crio-accdea5e3fc2b5a9540e02fa1aaa98acd2c9b37a80596aeb8331f9a9c6411f7d WatchSource:0}: Error finding container accdea5e3fc2b5a9540e02fa1aaa98acd2c9b37a80596aeb8331f9a9c6411f7d: Status 404 returned error can't find the container with id accdea5e3fc2b5a9540e02fa1aaa98acd2c9b37a80596aeb8331f9a9c6411f7d
Jul 16 22:30:44.379566 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.379509    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:30:44.379644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.379601    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:30:44.379644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.379637    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:30:44.828224 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.828184    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerStarted","Data":"44703efad5de80bb51dc95ad4f10e72db37ff64491d9c16d65aaf58d823966b9"}
Jul 16 22:30:44.828442 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.828244    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerStarted","Data":"accdea5e3fc2b5a9540e02fa1aaa98acd2c9b37a80596aeb8331f9a9c6411f7d"}
Jul 16 22:30:44.853985 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:44.853928    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podStartSLOduration=1.853905183 podStartE2EDuration="1.853905183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:30:44.852938148 +0000 UTC m=+2500.157035515" watchObservedRunningTime="2026-07-16 22:30:44.853905183 +0000 UTC m=+2500.158002551"
Jul 16 22:30:45.230052 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:45.230020    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:45.235880 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:45.235854    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:45.832829 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:45.832793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:30:45.833741 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:30:45.833720    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:01.573352 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.572861    2568 patch_prober.go:28] interesting pod/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:50998->10.133.0.36:15021: read: connection reset by peer" start-of-body=
Jul 16 22:31:01.573352 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.572948    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": read tcp 10.133.0.2:50998->10.133.0.36:15021: read: connection reset by peer"
Jul 16 22:31:01.925199 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.925167    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerID="44703efad5de80bb51dc95ad4f10e72db37ff64491d9c16d65aaf58d823966b9" exitCode=0
Jul 16 22:31:01.925367 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.925245    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerDied","Data":"44703efad5de80bb51dc95ad4f10e72db37ff64491d9c16d65aaf58d823966b9"}
Jul 16 22:31:01.925761 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.925744    2568 scope.go:117] "RemoveContainer" containerID="44703efad5de80bb51dc95ad4f10e72db37ff64491d9c16d65aaf58d823966b9"
Jul 16 22:31:01.926818 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.926791    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:01.926894 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.926861    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:01.926938 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:01.926891    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:02.932139 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:02.932109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerStarted","Data":"dc7799cb68a590bbdf378b3104358885b77750c7ee4c07a9d96f957091adf73b"}
Jul 16 22:31:03.227868 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:03.227777    2568 patch_prober.go:28] interesting pod/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 16 22:31:03.227868 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:03.227835    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 16 22:31:03.233223 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:03.233202    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:04.228188 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:04.228151    2568 patch_prober.go:28] interesting pod/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 16 22:31:04.228626 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:04.228213    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 16 22:31:05.228168 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:05.228121    2568 patch_prober.go:28] interesting pod/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 16 22:31:05.228343 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:05.228195    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 16 22:31:06.227746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:06.227707    2568 patch_prober.go:28] interesting pod/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 16 22:31:06.227977 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:06.227783    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 16 22:31:07.233876 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:07.233849    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:07.234245 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:07.234172    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:07.234914 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:07.234894    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:24.919758 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:24.919722    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:31:24.920238 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:24.919961    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy" containerID="cri-o://dc7799cb68a590bbdf378b3104358885b77750c7ee4c07a9d96f957091adf73b" gracePeriod=30
Jul 16 22:31:30.059863 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.059833    2568 generic.go:356] "Generic (PLEG): container finished" podID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerID="dc7799cb68a590bbdf378b3104358885b77750c7ee4c07a9d96f957091adf73b" exitCode=0
Jul 16 22:31:30.060266 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.059881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerDied","Data":"dc7799cb68a590bbdf378b3104358885b77750c7ee4c07a9d96f957091adf73b"}
Jul 16 22:31:30.060266 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.059930    2568 scope.go:117] "RemoveContainer" containerID="44703efad5de80bb51dc95ad4f10e72db37ff64491d9c16d65aaf58d823966b9"
Jul 16 22:31:30.180268 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.180238    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:30.275102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275007    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275052    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275113    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275129    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275155    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275263    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gqpd\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275311    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275608 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275368    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275608 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275419    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:31:30.275608 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275430    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token\") pod \"7bb5fb04-ec76-424d-a480-be0e62438ddf\" (UID: \"7bb5fb04-ec76-424d-a480-be0e62438ddf\") "
Jul 16 22:31:30.275608 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275460    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:31:30.275806 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275687    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:31:30.275806 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275693    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:31:30.275907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275844    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.275907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275868    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bb5fb04-ec76-424d-a480-be0e62438ddf-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.275907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275882    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.275907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.275895    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.276085 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.276022    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:31:30.277767 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.277733    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:31:30.277882 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.277811    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:31:30.278106 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.278085    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:31:30.278106 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.278095    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd" (OuterVolumeSpecName: "kube-api-access-6gqpd") pod "7bb5fb04-ec76-424d-a480-be0e62438ddf" (UID: "7bb5fb04-ec76-424d-a480-be0e62438ddf"). InnerVolumeSpecName "kube-api-access-6gqpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:31:30.377420 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.377381    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.377420 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.377424    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.377420 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.377439    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.377689 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.377453    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bb5fb04-ec76-424d-a480-be0e62438ddf-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:30.377689 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:30.377468    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gqpd\" (UniqueName: \"kubernetes.io/projected/7bb5fb04-ec76-424d-a480-be0e62438ddf-kube-api-access-6gqpd\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:31:31.066828 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.066796    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"
Jul 16 22:31:31.066828 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.066815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t" event={"ID":"7bb5fb04-ec76-424d-a480-be0e62438ddf","Type":"ContainerDied","Data":"accdea5e3fc2b5a9540e02fa1aaa98acd2c9b37a80596aeb8331f9a9c6411f7d"}
Jul 16 22:31:31.067330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.066871    2568 scope.go:117] "RemoveContainer" containerID="dc7799cb68a590bbdf378b3104358885b77750c7ee4c07a9d96f957091adf73b"
Jul 16 22:31:31.143619 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.143588    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:31:31.158275 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.158236    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5d6c742e-openshift-default-75f8c4b8ff-lsf5t"]
Jul 16 22:31:31.233394 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:31.233357    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" path="/var/lib/kubelet/pods/7bb5fb04-ec76-424d-a480-be0e62438ddf/volumes"
Jul 16 22:31:51.298595 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298560    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:31:51.298977 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298905    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:31:51.298977 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298916    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:31:51.299048 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298984    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="904d47b1-4264-496e-bb8e-02fe786366b4" containerName="istio-proxy"
Jul 16 22:31:51.299048 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298993    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:31:51.299048 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.298999    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:31:51.304696 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.303314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.309559 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.309506    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f5e7ed86-openshift-default-dockercfg-7mtgr\""
Jul 16 22:31:51.331400 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.331371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:31:51.381644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.381644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381644    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.381854 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.381854 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.381854 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2s4p\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.382008 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.382008 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.381954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.382293 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.382028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.382293 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.382062    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.482886 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.482844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.482886 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.482885    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2s4p\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.482918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.482950    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.482994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483008    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483496 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483466    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483596 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483657 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483702 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.483780 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.483707    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.486087 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.486067    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.486407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.486383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.494514 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.494492    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.494685 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.494668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2s4p\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p\") pod \"e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") " pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.615637 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.615547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:51.796069 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.796038    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:31:51.800364 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:31:51.800338    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6544828a_6a01_4d46_8538_543dc83155db.slice/crio-c70688fb1f0b19357ffbca079babf718feff27bfa87cedf19156962f37b3047a WatchSource:0}: Error finding container c70688fb1f0b19357ffbca079babf718feff27bfa87cedf19156962f37b3047a: Status 404 returned error can't find the container with id c70688fb1f0b19357ffbca079babf718feff27bfa87cedf19156962f37b3047a
Jul 16 22:31:51.802423 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.802384    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:51.802495 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.802462    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:51.802495 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:51.802491    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:31:52.165042 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:52.165005    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerStarted","Data":"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"}
Jul 16 22:31:52.165248 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:52.165062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerStarted","Data":"c70688fb1f0b19357ffbca079babf718feff27bfa87cedf19156962f37b3047a"}
Jul 16 22:31:52.213724 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:52.213663    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podStartSLOduration=1.213642325 podStartE2EDuration="1.213642325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:31:52.212861228 +0000 UTC m=+2567.516958598" watchObservedRunningTime="2026-07-16 22:31:52.213642325 +0000 UTC m=+2567.517739692"
Jul 16 22:31:52.616358 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:52.616267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:52.621685 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:52.621659    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:53.170862 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:53.170834    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:31:53.172009 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:31:53.171983    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:32:08.172660 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.172621    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 22:32:08.173073 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.172692    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 22:32:08.241062 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.241028    2568 generic.go:356] "Generic (PLEG): container finished" podID="6544828a-6a01-4d46-8538-543dc83155db" containerID="0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3" exitCode=0
Jul 16 22:32:08.241235 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.241056    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerDied","Data":"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"}
Jul 16 22:32:08.241512 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.241498    2568 scope.go:117] "RemoveContainer" containerID="0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"
Jul 16 22:32:08.242583 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.242555    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:32:08.242683 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.242628    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:32:08.242683 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:08.242662    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:32:09.247120 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:09.247086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerStarted","Data":"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"}
Jul 16 22:32:09.615953 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:09.615865    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:32:09.616125 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:09.616103    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 22:32:09.616182 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:09.616163    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 22:32:10.616040 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:10.615994    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 22:32:10.616553 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:10.616048    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 22:32:11.616692 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:11.616652    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 22:32:11.617102 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:11.616722    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 22:32:12.616134 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:12.616096    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 16 22:32:12.616319 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:12.616163    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 16 22:32:13.621062 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:13.621027    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:32:13.621537 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:13.621371    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:32:13.621989 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:32:13.621975    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:33:54.929401 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:33:54.929364    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:33:54.929873 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:33:54.929657    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" containerID="cri-o://b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27" gracePeriod=30
Jul 16 22:33:58.623402 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:33:58.623363    2568 patch_prober.go:28] interesting pod/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:33:58.623883 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:33:58.623425    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:34:00.199503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.199431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:34:00.365729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365692    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2s4p\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365751    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365776    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365882    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.365929 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.365916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.366232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366004    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.366232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366047    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs\") pod \"6544828a-6a01-4d46-8538-543dc83155db\" (UID: \"6544828a-6a01-4d46-8538-543dc83155db\") "
Jul 16 22:34:00.366232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366067    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:34:00.366232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366106    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:34:00.366485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366327    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:34:00.366485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366350    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.366485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366376    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.366485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.366420    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:34:00.367058 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.367031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data" (OuterVolumeSpecName: "istio-data") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:34:00.368263 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.368230    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token" (OuterVolumeSpecName: "istio-token") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:34:00.368365 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.368274    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p" (OuterVolumeSpecName: "kube-api-access-h2s4p") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "kube-api-access-h2s4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:34:00.368365 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.368293    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:34:00.368365 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.368353    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6544828a-6a01-4d46-8538-543dc83155db" (UID: "6544828a-6a01-4d46-8538-543dc83155db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467069    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6544828a-6a01-4d46-8538-543dc83155db-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467103    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467113    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467122    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467130    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2s4p\" (UniqueName: \"kubernetes.io/projected/6544828a-6a01-4d46-8538-543dc83155db-kube-api-access-h2s4p\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467148    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6544828a-6a01-4d46-8538-543dc83155db-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.467157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.467156    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6544828a-6a01-4d46-8538-543dc83155db-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:34:00.764882 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.764789    2568 generic.go:356] "Generic (PLEG): container finished" podID="6544828a-6a01-4d46-8538-543dc83155db" containerID="b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27" exitCode=0
Jul 16 22:34:00.764882 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.764840    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"
Jul 16 22:34:00.765119 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.764876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerDied","Data":"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"}
Jul 16 22:34:00.765119 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.764940    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f" event={"ID":"6544828a-6a01-4d46-8538-543dc83155db","Type":"ContainerDied","Data":"c70688fb1f0b19357ffbca079babf718feff27bfa87cedf19156962f37b3047a"}
Jul 16 22:34:00.765119 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.764972    2568 scope.go:117] "RemoveContainer" containerID="b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"
Jul 16 22:34:00.774166 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.774143    2568 scope.go:117] "RemoveContainer" containerID="0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"
Jul 16 22:34:00.784516 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.784495    2568 scope.go:117] "RemoveContainer" containerID="b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"
Jul 16 22:34:00.784837 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:34:00.784812    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27\": container with ID starting with b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27 not found: ID does not exist" containerID="b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"
Jul 16 22:34:00.784911 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.784855    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27"} err="failed to get container status \"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27\": rpc error: code = NotFound desc = could not find container \"b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27\": container with ID starting with b9ef048a94f8cc750b202071e3dbe00be135fa61a0562430e776d97ab518ed27 not found: ID does not exist"
Jul 16 22:34:00.784911 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.784882    2568 scope.go:117] "RemoveContainer" containerID="0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"
Jul 16 22:34:00.785176 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:34:00.785155    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3\": container with ID starting with 0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3 not found: ID does not exist" containerID="0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"
Jul 16 22:34:00.785233 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.785187    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3"} err="failed to get container status \"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3\": rpc error: code = NotFound desc = could not find container \"0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3\": container with ID starting with 0f3da1bc09f64e432397e0631cb7d503a5a2f0e58065a60392c0b379e49101a3 not found: ID does not exist"
Jul 16 22:34:00.793698 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.793672    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:34:00.808852 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:00.808816    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f5e7ed86-openshift-default-5c48ff545f-xgs2f"]
Jul 16 22:34:01.239318 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:01.239282    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6544828a-6a01-4d46-8538-543dc83155db" path="/var/lib/kubelet/pods/6544828a-6a01-4d46-8538-543dc83155db/volumes"
Jul 16 22:34:51.522047 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522008    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522379    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522391    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522407    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522413    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bb5fb04-ec76-424d-a480-be0e62438ddf" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522421    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522426    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522490    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.522541 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.522497    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6544828a-6a01-4d46-8538-543dc83155db" containerName="istio-proxy"
Jul 16 22:34:51.525488 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.525471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.528262 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.528243    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fb6c08-openshift-default-dockercfg-6ck4s\""
Jul 16 22:34:51.545306 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.545278    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:34:51.555594 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555594 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc58t\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555670    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555978 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.555978 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.555874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656511 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656747 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656747 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656589    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656747 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656747 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656972 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656972 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656972 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.656972 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc58t\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.657168 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.656976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.657256 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.657235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.657318 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.657283    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.657375 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.657320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.657628 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.657607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.659360 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.659341    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.659495 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.659477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.670021 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.669995    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.670377 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.670344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc58t\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t\") pod \"e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") " pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.835581 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.835459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:51.985149 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.985117    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:34:51.986784 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:34:51.986758    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67a9060_38fa_47a1_8d66_fef17e705186.slice/crio-cc6e35c37b795f68858520bd773647d59ddc7a649e0ac761c5ac0cbafbfa0b25 WatchSource:0}: Error finding container cc6e35c37b795f68858520bd773647d59ddc7a649e0ac761c5ac0cbafbfa0b25: Status 404 returned error can't find the container with id cc6e35c37b795f68858520bd773647d59ddc7a649e0ac761c5ac0cbafbfa0b25
Jul 16 22:34:51.988941 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.988908    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:34:51.989040 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.988972    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:34:51.989040 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:51.989002    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:34:52.003044 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:52.003013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerStarted","Data":"cc6e35c37b795f68858520bd773647d59ddc7a649e0ac761c5ac0cbafbfa0b25"}
Jul 16 22:34:53.009470 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:53.009438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerStarted","Data":"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"}
Jul 16 22:34:53.038676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:53.038615    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podStartSLOduration=2.038595499 podStartE2EDuration="2.038595499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:34:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:34:53.036869271 +0000 UTC m=+2748.340966637" watchObservedRunningTime="2026-07-16 22:34:53.038595499 +0000 UTC m=+2748.342692866"
Jul 16 22:34:53.836401 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:53.836358    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:53.841265 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:53.841234    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:54.014808 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:54.014778    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:34:54.015889 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:34:54.015869    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:35:00.316802 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.316771    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:35:00.320439 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.320408    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.323880 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.323858    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2dbd48-openshift-default-dockercfg-d2vtz\""
Jul 16 22:35:00.333733 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.333707    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:35:00.448010 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.447973    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448010 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448139    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448167    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448347 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448347 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448347 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.448445 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.448346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75jv\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549706 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549662    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549706 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549706    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c75jv\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.549954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550173 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.549981    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550173 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550173 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550056    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550333 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550333 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550279    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550794 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.550794 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.550609    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.552390 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.552367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.552539 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.552505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.558619 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.558592    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.558751 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.558734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75jv\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv\") pod \"e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") " pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.631986 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.631880    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:00.793423 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.793399    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:35:00.795391 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:35:00.795364    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca992489_500a_4aaa_90ef_cc9628766aff.slice/crio-a943e4649b729c8fded5531d618e963ca08e7b4de83f17b95fdf8f3489841b8a WatchSource:0}: Error finding container a943e4649b729c8fded5531d618e963ca08e7b4de83f17b95fdf8f3489841b8a: Status 404 returned error can't find the container with id a943e4649b729c8fded5531d618e963ca08e7b4de83f17b95fdf8f3489841b8a
Jul 16 22:35:00.797687 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.797654    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:00.797778 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.797723    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:00.797778 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:00.797752    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:01.051620 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:01.051586    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerStarted","Data":"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"}
Jul 16 22:35:01.051802 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:01.051640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerStarted","Data":"a943e4649b729c8fded5531d618e963ca08e7b4de83f17b95fdf8f3489841b8a"}
Jul 16 22:35:01.098814 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:01.098752    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podStartSLOduration=1.098732717 podStartE2EDuration="1.098732717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:01.094955643 +0000 UTC m=+2756.399053010" watchObservedRunningTime="2026-07-16 22:35:01.098732717 +0000 UTC m=+2756.402830083"
Jul 16 22:35:01.632611 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:01.632566    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:01.638157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:01.638127    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:02.056434 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:02.056410    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:02.057566 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:02.057548    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:10.057706 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:10.057667    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:35:10.058112 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:10.057769    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:35:11.107419 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.107329    2568 generic.go:356] "Generic (PLEG): container finished" podID="a67a9060-38fa-47a1-8d66-fef17e705186" containerID="4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3" exitCode=0
Jul 16 22:35:11.107845 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.107411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerDied","Data":"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"}
Jul 16 22:35:11.107892 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.107850    2568 scope.go:117] "RemoveContainer" containerID="4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"
Jul 16 22:35:11.108906 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.108881    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:11.108992 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.108953    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:11.108992 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:11.108983    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:12.117677 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:12.117632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerStarted","Data":"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"}
Jul 16 22:35:12.836391 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:12.836358    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:35:12.836660 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:12.836635    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 22:35:12.836724 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:12.836694    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 22:35:13.836893 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:13.836853    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 22:35:13.837300 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:13.836918    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 22:35:14.836661 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:14.836623    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 22:35:14.836828 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:14.836674    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 22:35:15.836353 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:15.836309    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 16 22:35:15.836882 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:15.836390    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 16 22:35:16.840377 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:16.840336    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:35:16.840782 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:16.840742    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:35:16.841273 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:16.841253    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:35:17.845284 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:17.845101    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": read tcp 10.133.0.2:37038->10.133.0.39:15021: read: connection reset by peer" start-of-body=
Jul 16 22:35:17.845284 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:17.845175    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": read tcp 10.133.0.2:37038->10.133.0.39:15021: read: connection reset by peer"
Jul 16 22:35:18.150847 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.150812    2568 generic.go:356] "Generic (PLEG): container finished" podID="ca992489-500a-4aaa-90ef-cc9628766aff" containerID="0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050" exitCode=0
Jul 16 22:35:18.151026 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.150889    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerDied","Data":"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"}
Jul 16 22:35:18.151462 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.151446    2568 scope.go:117] "RemoveContainer" containerID="0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"
Jul 16 22:35:18.152464 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.152435    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:18.152590 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.152502    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:18.152590 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:18.152554    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:35:19.158469 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:19.158437    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerStarted","Data":"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"}
Jul 16 22:35:19.633047 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:19.632946    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:19.633218 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:19.633201    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 16 22:35:19.633263 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:19.633246    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 16 22:35:20.632968 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:20.632930    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 16 22:35:20.633364 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:20.632990    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 16 22:35:21.632620 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:21.632582    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 16 22:35:21.632838 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:21.632644    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 16 22:35:22.633271 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:22.633227    2568 patch_prober.go:28] interesting pod/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 16 22:35:22.633743 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:22.633287    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 16 22:35:23.636315 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:23.636285    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:23.636743 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:23.636567    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:23.637202 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:23.637186    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:35:26.678260 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.678180    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:35:26.681684 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.681665    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.686621 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.686590    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fb6c08\"/\"default-dockercfg-pk4rw\""
Jul 16 22:35:26.686769 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.686595    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fb6c08\"/\"test-model-fb6c08-kserve-self-signed-certs\""
Jul 16 22:35:26.686769 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.686746    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fb6c08\"/\"kube-root-ca.crt\""
Jul 16 22:35:26.686903 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.686891    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fb6c08\"/\"openshift-service-ca.crt\""
Jul 16 22:35:26.696806 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.696776    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:35:26.737722 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.737892 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.737892 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737849    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.737892 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.738067 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737894    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhzlc\" (UniqueName: \"kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.738067 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.737970    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.838953 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.838905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.838970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.838996    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhzlc\" (UniqueName: \"kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839415 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839793 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.839894 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.839770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.842225 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.842192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.842451 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.842429    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.850716 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.850684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhzlc\" (UniqueName: \"kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc\") pod \"test-model-fb6c08-kserve-57dd879fb7-2qttf\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") " pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:26.991096 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:26.991003    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:27.133148 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:27.133121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:35:27.135447 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:35:27.135409    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee3500f4_35a3_4d55_b36f_a105eb5f0bef.slice/crio-7918f3bb2ce7d7e7c879042b05eb1ffd1685b601773aa1594a66711f5b96981e WatchSource:0}: Error finding container 7918f3bb2ce7d7e7c879042b05eb1ffd1685b601773aa1594a66711f5b96981e: Status 404 returned error can't find the container with id 7918f3bb2ce7d7e7c879042b05eb1ffd1685b601773aa1594a66711f5b96981e
Jul 16 22:35:27.202601 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:27.202512    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" event={"ID":"ee3500f4-35a3-4d55-b36f-a105eb5f0bef","Type":"ContainerStarted","Data":"7918f3bb2ce7d7e7c879042b05eb1ffd1685b601773aa1594a66711f5b96981e"}
Jul 16 22:35:27.221946 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:27.221890    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" podStartSLOduration=1.221872984 podStartE2EDuration="1.221872984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:35:27.220492552 +0000 UTC m=+2782.524589920" watchObservedRunningTime="2026-07-16 22:35:27.221872984 +0000 UTC m=+2782.525970350"
Jul 16 22:35:28.209119 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:28.209079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" event={"ID":"ee3500f4-35a3-4d55-b36f-a105eb5f0bef","Type":"ContainerStarted","Data":"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"}
Jul 16 22:35:36.991371 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:36.991330    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:36.991787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:36.991387    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:37.003991 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:37.003960    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:35:37.265193 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:35:37.265102    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:36:16.780104 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:16.780064    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:36:31.800790 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:31.800724    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" podUID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" containerName="main" containerID="cri-o://9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c" gracePeriod=45
Jul 16 22:36:32.064614 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.064539    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:36:32.174220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174171    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhzlc\" (UniqueName: \"kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174227    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174497 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174257    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174497 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174438    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174648 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174598    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174724 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174709    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache\") pod \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\" (UID: \"ee3500f4-35a3-4d55-b36f-a105eb5f0bef\") "
Jul 16 22:36:32.174785 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174595    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home" (OuterVolumeSpecName: "home") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:32.174836 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.174807    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:32.175073 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.175056    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-home\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.175135 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.175075    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tmp-dir\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.175171 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.175145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:32.176688 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.176666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:36:32.177084 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.177064    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm" (OuterVolumeSpecName: "dshm") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:32.177153 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.177080    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc" (OuterVolumeSpecName: "kube-api-access-mhzlc") pod "ee3500f4-35a3-4d55-b36f-a105eb5f0bef" (UID: "ee3500f4-35a3-4d55-b36f-a105eb5f0bef"). InnerVolumeSpecName "kube-api-access-mhzlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:32.275750 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.275708    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhzlc\" (UniqueName: \"kubernetes.io/projected/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-kube-api-access-mhzlc\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.275750 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.275741    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-tls-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.275750 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.275754    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-dshm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.275995 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.275769    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee3500f4-35a3-4d55-b36f-a105eb5f0bef-model-cache\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:32.521221 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.521185    2568 generic.go:356] "Generic (PLEG): container finished" podID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" containerID="9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c" exitCode=0
Jul 16 22:36:32.521469 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.521231    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"
Jul 16 22:36:32.521469 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.521276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" event={"ID":"ee3500f4-35a3-4d55-b36f-a105eb5f0bef","Type":"ContainerDied","Data":"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"}
Jul 16 22:36:32.521469 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.521316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf" event={"ID":"ee3500f4-35a3-4d55-b36f-a105eb5f0bef","Type":"ContainerDied","Data":"7918f3bb2ce7d7e7c879042b05eb1ffd1685b601773aa1594a66711f5b96981e"}
Jul 16 22:36:32.521469 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.521332    2568 scope.go:117] "RemoveContainer" containerID="9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"
Jul 16 22:36:32.531115 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.531096    2568 scope.go:117] "RemoveContainer" containerID="9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"
Jul 16 22:36:32.531408 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:36:32.531386    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c\": container with ID starting with 9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c not found: ID does not exist" containerID="9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"
Jul 16 22:36:32.531504 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.531414    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c"} err="failed to get container status \"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c\": rpc error: code = NotFound desc = could not find container \"9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c\": container with ID starting with 9c272caa5c381efc5b1d69e7cb163dc725ac4653fd06a5a3b2c895bb531c528c not found: ID does not exist"
Jul 16 22:36:32.543855 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.543820    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:36:32.549770 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:32.549739    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fb6c08/test-model-fb6c08-kserve-57dd879fb7-2qttf"]
Jul 16 22:36:33.233570 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:33.233516    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" path="/var/lib/kubelet/pods/ee3500f4-35a3-4d55-b36f-a105eb5f0bef/volumes"
Jul 16 22:36:43.852139 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:43.852103    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:36:43.852719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:43.852439    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" containerID="cri-o://d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d" gracePeriod=30
Jul 16 22:36:46.843169 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:46.843132    2568 patch_prober.go:28] interesting pod/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:36:46.843600 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:46.843214    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:36:49.106708 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.106682    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:36:49.138145 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138114    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc58t\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138203    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138232    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138324    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138642 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138379    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138642 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138439    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138642 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138490    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token\") pod \"a67a9060-38fa-47a1-8d66-fef17e705186\" (UID: \"a67a9060-38fa-47a1-8d66-fef17e705186\") "
Jul 16 22:36:49.138799 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138770    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:49.138881 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138846    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:36:49.138939 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138873    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:49.139017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.138995    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:49.139562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.139466    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.139562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.139509    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a67a9060-38fa-47a1-8d66-fef17e705186-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.139562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.139468    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data" (OuterVolumeSpecName: "istio-data") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:49.139562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.139546    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.139855 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.139585    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.140936 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.140911    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t" (OuterVolumeSpecName: "kube-api-access-xc58t") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "kube-api-access-xc58t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:49.141177 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.141161    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:36:49.141318 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.141303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token" (OuterVolumeSpecName: "istio-token") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:36:49.141454 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.141424    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a67a9060-38fa-47a1-8d66-fef17e705186" (UID: "a67a9060-38fa-47a1-8d66-fef17e705186"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:36:49.241220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.240992    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.241220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.241022    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc58t\" (UniqueName: \"kubernetes.io/projected/a67a9060-38fa-47a1-8d66-fef17e705186-kube-api-access-xc58t\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.241220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.241035    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a67a9060-38fa-47a1-8d66-fef17e705186-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.241220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.241043    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.241220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.241051    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a67a9060-38fa-47a1-8d66-fef17e705186-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:36:49.609699 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.609611    2568 generic.go:356] "Generic (PLEG): container finished" podID="a67a9060-38fa-47a1-8d66-fef17e705186" containerID="d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d" exitCode=0
Jul 16 22:36:49.609699 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.609673    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"
Jul 16 22:36:49.609699 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.609682    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerDied","Data":"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"}
Jul 16 22:36:49.609912 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.609757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4" event={"ID":"a67a9060-38fa-47a1-8d66-fef17e705186","Type":"ContainerDied","Data":"cc6e35c37b795f68858520bd773647d59ddc7a649e0ac761c5ac0cbafbfa0b25"}
Jul 16 22:36:49.609912 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.609780    2568 scope.go:117] "RemoveContainer" containerID="d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"
Jul 16 22:36:49.618761 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.618738    2568 scope.go:117] "RemoveContainer" containerID="4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"
Jul 16 22:36:49.627230 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.627211    2568 scope.go:117] "RemoveContainer" containerID="d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"
Jul 16 22:36:49.627546 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:36:49.627508    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d\": container with ID starting with d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d not found: ID does not exist" containerID="d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"
Jul 16 22:36:49.627660 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.627556    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d"} err="failed to get container status \"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d\": rpc error: code = NotFound desc = could not find container \"d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d\": container with ID starting with d0fd7652be172c75a0f4e99964ed7777ef9be0ab27474004d38b48ea8119462d not found: ID does not exist"
Jul 16 22:36:49.627660 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.627580    2568 scope.go:117] "RemoveContainer" containerID="4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"
Jul 16 22:36:49.627812 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:36:49.627791    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3\": container with ID starting with 4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3 not found: ID does not exist" containerID="4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"
Jul 16 22:36:49.627852 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.627820    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3"} err="failed to get container status \"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3\": rpc error: code = NotFound desc = could not find container \"4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3\": container with ID starting with 4b6693ea6c30b1cda83730b00a3a52a381d8e3db23932c608c9d8ab8dfafade3 not found: ID does not exist"
Jul 16 22:36:49.637210 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.637184    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:36:49.640729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:49.640704    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fb6c08-openshift-default-5cf95f7995-ck2b4"]
Jul 16 22:36:51.233789 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:36:51.233756    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" path="/var/lib/kubelet/pods/a67a9060-38fa-47a1-8d66-fef17e705186/volumes"
Jul 16 22:37:10.049156 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.049111    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:37:10.051328 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.051286    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy" containerID="cri-o://5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160" gracePeriod=30
Jul 16 22:37:10.997154 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997117    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:37:10.997479 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997467    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" containerName="main"
Jul 16 22:37:10.997544 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997480    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" containerName="main"
Jul 16 22:37:10.997544 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997498    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:10.997544 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997504    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:10.997649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997583    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:10.997649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997592    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:10.997649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:10.997599    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3500f4-35a3-4d55-b36f-a105eb5f0bef" containerName="main"
Jul 16 22:37:11.002232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.002214    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.006186 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.006158    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-14b5b4-openshift-default-dockercfg-z6srm\""
Jul 16 22:37:11.018328 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.018295    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:37:11.163701 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163659    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163710    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163858    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.163974    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq69v\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.164066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.164099    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.164138 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.164118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.264965 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.264860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.264965 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.264918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.264965 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.264949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265258 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265157    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265493 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq69v\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265493 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265493 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265456    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265493 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265480    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265759 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.265999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.265983    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.267892 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.267869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.268142 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.268107    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.275135 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.275107    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.275454 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.275431    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq69v\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v\") pod \"e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") " pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.312374 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.312342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:11.467349 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.467318    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:37:11.468378 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:37:11.468352    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5964f42d_320c_45cd_9b92_b07408c83bca.slice/crio-8089e65e6bd0b375e194de12df398165334d54335bc8401c8a1966d659b4596b WatchSource:0}: Error finding container 8089e65e6bd0b375e194de12df398165334d54335bc8401c8a1966d659b4596b: Status 404 returned error can't find the container with id 8089e65e6bd0b375e194de12df398165334d54335bc8401c8a1966d659b4596b
Jul 16 22:37:11.470695 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.470659    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:11.470769 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.470744    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:11.470804 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.470787    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:11.715908 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.715873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerStarted","Data":"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"}
Jul 16 22:37:11.716113 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.715934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerStarted","Data":"8089e65e6bd0b375e194de12df398165334d54335bc8401c8a1966d659b4596b"}
Jul 16 22:37:11.741511 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:11.741457    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podStartSLOduration=1.7414384090000001 podStartE2EDuration="1.741438409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:37:11.739494167 +0000 UTC m=+2887.043591535" watchObservedRunningTime="2026-07-16 22:37:11.741438409 +0000 UTC m=+2887.045535777"
Jul 16 22:37:12.312675 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:12.312641    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:12.317957 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:12.317934    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:12.721041 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:12.721009    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:12.722085 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:12.722067    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:15.308020 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.307990    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:37:15.405612 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405571    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.405824 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405619    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.405824 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405661    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.405824 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405721    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.405824 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405747    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.405824 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c75jv\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.406083 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.406083 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405900    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.406083 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.405934    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token\") pod \"ca992489-500a-4aaa-90ef-cc9628766aff\" (UID: \"ca992489-500a-4aaa-90ef-cc9628766aff\") "
Jul 16 22:37:15.406235 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406065    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:37:15.406329 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:37:15.406414 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406373    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca992489-500a-4aaa-90ef-cc9628766aff-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.406482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406145    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:37:15.406482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406462    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:37:15.406685 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.406665    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:37:15.408239 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.408211    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:37:15.408342 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.408265    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:37:15.408695 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.408672    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv" (OuterVolumeSpecName: "kube-api-access-c75jv") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "kube-api-access-c75jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:37:15.408776 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.408723    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca992489-500a-4aaa-90ef-cc9628766aff" (UID: "ca992489-500a-4aaa-90ef-cc9628766aff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:37:15.507003 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.506964    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507003 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.506992    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507003 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507002    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507003 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507009    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca992489-500a-4aaa-90ef-cc9628766aff-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507264 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507019    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507264 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507027    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507264 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507036    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca992489-500a-4aaa-90ef-cc9628766aff-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.507264 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.507045    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c75jv\" (UniqueName: \"kubernetes.io/projected/ca992489-500a-4aaa-90ef-cc9628766aff-kube-api-access-c75jv\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:37:15.736105 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.736016    2568 generic.go:356] "Generic (PLEG): container finished" podID="ca992489-500a-4aaa-90ef-cc9628766aff" containerID="5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160" exitCode=0
Jul 16 22:37:15.736105 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.736073    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"
Jul 16 22:37:15.736281 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.736098    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerDied","Data":"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"}
Jul 16 22:37:15.736281 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.736188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd" event={"ID":"ca992489-500a-4aaa-90ef-cc9628766aff","Type":"ContainerDied","Data":"a943e4649b729c8fded5531d618e963ca08e7b4de83f17b95fdf8f3489841b8a"}
Jul 16 22:37:15.736281 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.736216    2568 scope.go:117] "RemoveContainer" containerID="5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"
Jul 16 22:37:15.746099 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.746074    2568 scope.go:117] "RemoveContainer" containerID="0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"
Jul 16 22:37:15.754885 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.754861    2568 scope.go:117] "RemoveContainer" containerID="5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"
Jul 16 22:37:15.755188 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:37:15.755166    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160\": container with ID starting with 5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160 not found: ID does not exist" containerID="5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"
Jul 16 22:37:15.755270 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.755196    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160"} err="failed to get container status \"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160\": rpc error: code = NotFound desc = could not find container \"5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160\": container with ID starting with 5bde9c51dc1a7ec4ddba31d551cb0fcaaccfd334e82e4b412034ec84db5dc160 not found: ID does not exist"
Jul 16 22:37:15.755270 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.755216    2568 scope.go:117] "RemoveContainer" containerID="0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"
Jul 16 22:37:15.755466 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:37:15.755450    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050\": container with ID starting with 0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050 not found: ID does not exist" containerID="0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"
Jul 16 22:37:15.755510 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.755472    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050"} err="failed to get container status \"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050\": rpc error: code = NotFound desc = could not find container \"0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050\": container with ID starting with 0fdee7157e1feb9a37490a41d606a0ecf3b54738b0c99e4d6921c2c779ba0050 not found: ID does not exist"
Jul 16 22:37:15.760073 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.760036    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:37:15.768976 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:15.768948    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2dbd48-openshift-default-768647b795-qbddd"]
Jul 16 22:37:17.233540 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:17.233494    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" path="/var/lib/kubelet/pods/ca992489-500a-4aaa-90ef-cc9628766aff/volumes"
Jul 16 22:37:19.064948 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.064916    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:37:19.065314 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065292    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.065314 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065305    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.065382 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065316    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.065382 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065322    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.065382 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065334    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:19.065382 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065339    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a67a9060-38fa-47a1-8d66-fef17e705186" containerName="istio-proxy"
Jul 16 22:37:19.065500 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065394    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.065500 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.065402    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca992489-500a-4aaa-90ef-cc9628766aff" containerName="istio-proxy"
Jul 16 22:37:19.069971 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.069953    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.073021 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.072999    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ea0330-openshift-default-dockercfg-xbl2b\""
Jul 16 22:37:19.085596 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.085572    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:37:19.245045 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245259 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqhr\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245259 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245259 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245148    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245259 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245259 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245198    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245579 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245579 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.245579 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.245436    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346472 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346350    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346472 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346472 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346472 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqhr\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346549    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.346861 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.347125 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.346870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.347125 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.347090    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.347269 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.347246    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.347384 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.347280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.347384 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.347324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.348958 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.348938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.349161 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.349142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.355716 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.355692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqhr\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.355817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.355782    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token\") pod \"e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") " pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.380419 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.380370    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:19.533945 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.533826    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:37:19.537008 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:37:19.536977    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd312f2_96e9_4cbf_ad8c_960211127b28.slice/crio-d852a8f8577c8c3fd1989440c3c5d58e10b2c5faafab8f7884241fc2ed22a014 WatchSource:0}: Error finding container d852a8f8577c8c3fd1989440c3c5d58e10b2c5faafab8f7884241fc2ed22a014: Status 404 returned error can't find the container with id d852a8f8577c8c3fd1989440c3c5d58e10b2c5faafab8f7884241fc2ed22a014
Jul 16 22:37:19.539147 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.539110    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:19.539219 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.539205    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:19.539266 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.539251    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:19.759578 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.759516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerStarted","Data":"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"}
Jul 16 22:37:19.759780 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.759611    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerStarted","Data":"d852a8f8577c8c3fd1989440c3c5d58e10b2c5faafab8f7884241fc2ed22a014"}
Jul 16 22:37:19.783713 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:19.783640    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podStartSLOduration=0.783616344 podStartE2EDuration="783.616344ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:37:19.781082095 +0000 UTC m=+2895.085179489" watchObservedRunningTime="2026-07-16 22:37:19.783616344 +0000 UTC m=+2895.087713711"
Jul 16 22:37:20.383233 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:20.383189    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:20.395242 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:20.395212    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:20.763963 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:20.763931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:20.765017 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:20.764998    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:27.722123 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.722084    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 22:37:27.722574 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.722168    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 22:37:27.800767 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.800726    2568 generic.go:356] "Generic (PLEG): container finished" podID="5964f42d-320c-45cd-9b92-b07408c83bca" containerID="c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21" exitCode=0
Jul 16 22:37:27.800926 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.800797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerDied","Data":"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"}
Jul 16 22:37:27.801215 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.801200    2568 scope.go:117] "RemoveContainer" containerID="c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"
Jul 16 22:37:27.802345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.802312    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:27.802407 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.802388    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:27.802442 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:27.802435    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:28.807321 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:28.807285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerStarted","Data":"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"}
Jul 16 22:37:29.312676 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:29.312562    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:29.312958 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:29.312925    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 22:37:29.313067 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:29.312985    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 22:37:30.312743 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:30.312704    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 22:37:30.313161 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:30.312767    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 22:37:31.313157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:31.313107    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 22:37:31.313710 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:31.313216    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 22:37:32.313644 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:32.313605    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 22:37:32.314212 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:32.314178    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 22:37:33.317251 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:33.317223    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:33.317765 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:33.317746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:33.318969 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:33.318949    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:37:36.805707 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:36.805662    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:37:36.806153 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:36.805728    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:37:37.855043 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.855010    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerID="7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041" exitCode=0
Jul 16 22:37:37.855482 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.855092    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerDied","Data":"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"}
Jul 16 22:37:37.855598 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.855581    2568 scope.go:117] "RemoveContainer" containerID="7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"
Jul 16 22:37:37.856674 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.856644    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:37.856737 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.856720    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:37.856772 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:37.856763    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:37:38.862315 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:38.862284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerStarted","Data":"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"}
Jul 16 22:37:39.381310 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:39.381264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:39.381917 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:39.381889    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 22:37:39.382146 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:39.382118    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 22:37:40.380994 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:40.380952    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 22:37:40.381660 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:40.381606    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 22:37:41.381094 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:41.381044    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 22:37:41.381634 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:41.381119    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 22:37:42.381186 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:42.381145    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 22:37:42.381808 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:42.381777    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 22:37:43.384092 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:43.384063    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:43.384477 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:43.384332    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:37:43.385095 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:37:43.385080    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:38:00.383833 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:00.383798    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:38:00.384302 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:00.384059    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" containerID="cri-o://e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9" gracePeriod=30
Jul 16 22:38:03.320022 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:03.319982    2568 patch_prober.go:28] interesting pod/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 16 22:38:03.320405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:03.320056    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:38:05.638654 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.638621    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:38:05.744601 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744492    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744601 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744568    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq69v\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744603    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744638    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744688    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744731    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744771    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.744813 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.745113 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.744837    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs\") pod \"5964f42d-320c-45cd-9b92-b07408c83bca\" (UID: \"5964f42d-320c-45cd-9b92-b07408c83bca\") "
Jul 16 22:38:05.745113 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745002    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:05.745113 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:38:05.745295 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745272    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:05.745549 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745509    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5964f42d-320c-45cd-9b92-b07408c83bca-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.745643 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745555    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.745643 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745570    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.745745 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745653    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:05.745926 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.745906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data" (OuterVolumeSpecName: "istio-data") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:05.746946 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.746923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:38:05.747144 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.747121    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token" (OuterVolumeSpecName: "istio-token") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:38:05.747460 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.747436    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:05.747460 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.747451    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v" (OuterVolumeSpecName: "kube-api-access-bq69v") pod "5964f42d-320c-45cd-9b92-b07408c83bca" (UID: "5964f42d-320c-45cd-9b92-b07408c83bca"). InnerVolumeSpecName "kube-api-access-bq69v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:38:05.846334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846292    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.846334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846329    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.846334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846338    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5964f42d-320c-45cd-9b92-b07408c83bca-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.846334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846347    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5964f42d-320c-45cd-9b92-b07408c83bca-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.846623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846356    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq69v\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-kube-api-access-bq69v\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:05.846623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:05.846365    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5964f42d-320c-45cd-9b92-b07408c83bca-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:06.002232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.002151    2568 generic.go:356] "Generic (PLEG): container finished" podID="5964f42d-320c-45cd-9b92-b07408c83bca" containerID="e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9" exitCode=0
Jul 16 22:38:06.002232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.002188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerDied","Data":"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"}
Jul 16 22:38:06.002232 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.002210    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"
Jul 16 22:38:06.002454 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.002255    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb" event={"ID":"5964f42d-320c-45cd-9b92-b07408c83bca","Type":"ContainerDied","Data":"8089e65e6bd0b375e194de12df398165334d54335bc8401c8a1966d659b4596b"}
Jul 16 22:38:06.002454 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.002276    2568 scope.go:117] "RemoveContainer" containerID="e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"
Jul 16 22:38:06.011808 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.011790    2568 scope.go:117] "RemoveContainer" containerID="c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"
Jul 16 22:38:06.020261 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.020245    2568 scope.go:117] "RemoveContainer" containerID="e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"
Jul 16 22:38:06.020578 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:38:06.020556    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9\": container with ID starting with e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9 not found: ID does not exist" containerID="e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"
Jul 16 22:38:06.020672 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.020585    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9"} err="failed to get container status \"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9\": rpc error: code = NotFound desc = could not find container \"e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9\": container with ID starting with e06452596a4ea3ff2a1cc815a5868df0fe1c59be7674890ebf42d106d07744d9 not found: ID does not exist"
Jul 16 22:38:06.020672 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.020604    2568 scope.go:117] "RemoveContainer" containerID="c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"
Jul 16 22:38:06.020873 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:38:06.020855    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21\": container with ID starting with c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21 not found: ID does not exist" containerID="c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"
Jul 16 22:38:06.020927 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.020883    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21"} err="failed to get container status \"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21\": rpc error: code = NotFound desc = could not find container \"c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21\": container with ID starting with c4585a472fd91534b5ea688910b4bbae1644e8f7f4668c8794cf90cb71550d21 not found: ID does not exist"
Jul 16 22:38:06.030648 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.030623    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:38:06.032880 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:06.032860    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-14b5b4-openshift-default-5b4c769cc9-zbsfb"]
Jul 16 22:38:07.233588 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:07.233556    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" path="/var/lib/kubelet/pods/5964f42d-320c-45cd-9b92-b07408c83bca/volumes"
Jul 16 22:38:26.545949 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:26.545867    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:38:26.546390 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:26.546107    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" containerID="cri-o://8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea" gracePeriod=30
Jul 16 22:38:27.532350 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532312    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:38:27.532698 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532685    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.532759 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532699    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.532759 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532711    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.532759 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532716    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.532868 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532782    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.532868 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.532791    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5964f42d-320c-45cd-9b92-b07408c83bca" containerName="istio-proxy"
Jul 16 22:38:27.535716 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.535699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.541255 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.541234    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bb55e2-openshift-default-dockercfg-gb76l\""
Jul 16 22:38:27.550346 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.550310    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:38:27.665054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665064    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665220 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7t8p\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665359 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665359 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665359 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665322    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.665458 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.665401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766635 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766671    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766800 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766827    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.766999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.766942    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7t8p\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.767204 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.767064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.767204 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.767142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.767367 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.767314    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.767367 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.767362    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.768030 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.768000    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.769257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.769235    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.769481 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.769462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.776111 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.776079    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.776279 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.776257    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7t8p\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p\") pod \"e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") " pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:27.845883 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:27.845791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:28.020130 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.020104    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:38:28.021645 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:38:28.021619    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99d8264_6096_405a_ba31_0e7bbbb2c47a.slice/crio-0f3b8aa6f31d825c95e433184042dc4daa1cb585848613c4268ffb816797c5ea WatchSource:0}: Error finding container 0f3b8aa6f31d825c95e433184042dc4daa1cb585848613c4268ffb816797c5ea: Status 404 returned error can't find the container with id 0f3b8aa6f31d825c95e433184042dc4daa1cb585848613c4268ffb816797c5ea
Jul 16 22:38:28.023853 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.023813    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:28.023948 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.023896    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:28.023948 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.023926    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:28.109404 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.109304    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerStarted","Data":"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"}
Jul 16 22:38:28.109404 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.109370    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerStarted","Data":"0f3b8aa6f31d825c95e433184042dc4daa1cb585848613c4268ffb816797c5ea"}
Jul 16 22:38:28.136305 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.136248    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podStartSLOduration=1.136223764 podStartE2EDuration="1.136223764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:38:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:38:28.135709625 +0000 UTC m=+2963.439806991" watchObservedRunningTime="2026-07-16 22:38:28.136223764 +0000 UTC m=+2963.440321129"
Jul 16 22:38:28.387615 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.387579    2568 patch_prober.go:28] interesting pod/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:38:28.387775 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.387647    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:38:28.846434 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:28.846342    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:29.851782 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:29.851754    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:30.118663 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:30.118563    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:30.119707 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:30.119685    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:31.810049 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.809977    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:38:31.907019 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.906984    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907019 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907018    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907052    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gqhr\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907151    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907202    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907257 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907236    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907513 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907306    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907513 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907331    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert\") pod \"2fd312f2-96e9-4cbf-ad8c-960211127b28\" (UID: \"2fd312f2-96e9-4cbf-ad8c-960211127b28\") "
Jul 16 22:38:31.907513 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:31.907737 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907678    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:31.907737 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907720    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:31.907853 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.907834    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:31.908200 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.908143    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:38:31.908200 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.908199    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:31.909597 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.909565    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:38:31.909719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.909588    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr" (OuterVolumeSpecName: "kube-api-access-5gqhr") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "kube-api-access-5gqhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:38:31.909719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.909616    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:38:31.909829 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:31.909783    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fd312f2-96e9-4cbf-ad8c-960211127b28" (UID: "2fd312f2-96e9-4cbf-ad8c-960211127b28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:38:32.008798 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008766    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.008798 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008795    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.008798 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008805    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.009024 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008813    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fd312f2-96e9-4cbf-ad8c-960211127b28-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.009024 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008821    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.009024 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008829    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.009024 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008852    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd312f2-96e9-4cbf-ad8c-960211127b28-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.009024 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.008861    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gqhr\" (UniqueName: \"kubernetes.io/projected/2fd312f2-96e9-4cbf-ad8c-960211127b28-kube-api-access-5gqhr\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:38:32.129896 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.129810    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerID="8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea" exitCode=0
Jul 16 22:38:32.129896 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.129864    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"
Jul 16 22:38:32.130065 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.129897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerDied","Data":"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"}
Jul 16 22:38:32.130065 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.129957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl" event={"ID":"2fd312f2-96e9-4cbf-ad8c-960211127b28","Type":"ContainerDied","Data":"d852a8f8577c8c3fd1989440c3c5d58e10b2c5faafab8f7884241fc2ed22a014"}
Jul 16 22:38:32.130065 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.129980    2568 scope.go:117] "RemoveContainer" containerID="8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"
Jul 16 22:38:32.140134 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.140116    2568 scope.go:117] "RemoveContainer" containerID="7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"
Jul 16 22:38:32.151512 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.151487    2568 scope.go:117] "RemoveContainer" containerID="8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"
Jul 16 22:38:32.151837 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:38:32.151818    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea\": container with ID starting with 8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea not found: ID does not exist" containerID="8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"
Jul 16 22:38:32.151933 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.151850    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea"} err="failed to get container status \"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea\": rpc error: code = NotFound desc = could not find container \"8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea\": container with ID starting with 8497b8779032580fbe8b07c266cff66bf79d9566d4ad8567272abad3995e78ea not found: ID does not exist"
Jul 16 22:38:32.151933 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.151877    2568 scope.go:117] "RemoveContainer" containerID="7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"
Jul 16 22:38:32.152169 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:38:32.152151    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041\": container with ID starting with 7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041 not found: ID does not exist" containerID="7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"
Jul 16 22:38:32.152205 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.152175    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041"} err="failed to get container status \"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041\": rpc error: code = NotFound desc = could not find container \"7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041\": container with ID starting with 7ef4d517db35449c33d7f2ed8bb072f3a6873b07559e1906b10a07a8ad4c5041 not found: ID does not exist"
Jul 16 22:38:32.155668 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.155647    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:38:32.165038 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:32.165017    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ea0330-openshift-default-6bc7bc4dbf-j6kvl"]
Jul 16 22:38:33.233851 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:33.233809    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" path="/var/lib/kubelet/pods/2fd312f2-96e9-4cbf-ad8c-960211127b28/volumes"
Jul 16 22:38:35.317172 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317135    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:38:35.317560 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317508    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:38:35.317560 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317538    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:38:35.317560 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317557    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:38:35.317560 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317562    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:38:35.317697 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.317616    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:38:35.321656 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.321638    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.324344 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.324318    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-dbc614-openshift-default-dockercfg-vztd9\""
Jul 16 22:38:35.331931 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.331905    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:38:35.343306 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343407    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343611 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343495    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343716 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trfkx\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343771 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343740    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343837 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343814    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343919 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.343960 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.344014 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.343997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445248    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445275    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trfkx\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445501 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445480    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445880 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445697    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.445880 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445758    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.446025 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.445990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.446081 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.446035    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.446135 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.446073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.447839 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.447817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.448078 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.448057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.454346 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.454308    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.454456 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.454440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trfkx\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx\") pod \"e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") " pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.633298 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.633203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:35.786299 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.786274    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:38:35.789564 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:38:35.789505    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65a1873_4969_465a_9d3a_4e056cef31e1.slice/crio-0fcd60a3d7a4cd1b1a4f18313102d0be19e812819477ae427f83db829740b0dc WatchSource:0}: Error finding container 0fcd60a3d7a4cd1b1a4f18313102d0be19e812819477ae427f83db829740b0dc: Status 404 returned error can't find the container with id 0fcd60a3d7a4cd1b1a4f18313102d0be19e812819477ae427f83db829740b0dc
Jul 16 22:38:35.792253 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.792221    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:35.792334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.792293    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:35.792334 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:35.792324    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:36.154672 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:36.154639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerStarted","Data":"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"}
Jul 16 22:38:36.154875 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:36.154698    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerStarted","Data":"0fcd60a3d7a4cd1b1a4f18313102d0be19e812819477ae427f83db829740b0dc"}
Jul 16 22:38:36.195948 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:36.195877    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podStartSLOduration=1.195855853 podStartE2EDuration="1.195855853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:38:36.195783992 +0000 UTC m=+2971.499881365" watchObservedRunningTime="2026-07-16 22:38:36.195855853 +0000 UTC m=+2971.499953221"
Jul 16 22:38:36.634405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:36.634309    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:36.639467 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:36.639439    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:37.159673 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:37.159631    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:37.160581 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:37.160561    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:43.192750 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.192718    2568 generic.go:356] "Generic (PLEG): container finished" podID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerID="33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a" exitCode=0
Jul 16 22:38:43.193149 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.192787    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerDied","Data":"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"}
Jul 16 22:38:43.193235 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.193221    2568 scope.go:117] "RemoveContainer" containerID="33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"
Jul 16 22:38:43.194345 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.194308    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:43.194462 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.194382    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:43.194462 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:43.194422    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:44.201083 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:44.201048    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerStarted","Data":"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"}
Jul 16 22:38:44.846548 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:44.846504    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:44.847565 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:44.847541    2568 patch_prober.go:28] interesting pod/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 16 22:38:44.847624 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:44.847591    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 16 22:38:45.119050 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:45.118966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:45.846817 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:45.846782    2568 patch_prober.go:28] interesting pod/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 16 22:38:45.847212 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:45.846856    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 16 22:38:46.846777 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:46.846741    2568 patch_prober.go:28] interesting pod/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 16 22:38:46.846952 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:46.846838    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 16 22:38:47.847165 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:47.847123    2568 patch_prober.go:28] interesting pod/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 16 22:38:47.847582 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:47.847200    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 16 22:38:48.850684 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:48.850649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:48.851562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:48.851541    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:38:52.447646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:52.447613    2568 patch_prober.go:28] interesting pod/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:42228->10.133.0.44:15021: read: connection reset by peer" start-of-body=
Jul 16 22:38:52.448147 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:52.448107    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:42228->10.133.0.44:15021: read: connection reset by peer"
Jul 16 22:38:53.251984 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.251952    2568 generic.go:356] "Generic (PLEG): container finished" podID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerID="1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36" exitCode=0
Jul 16 22:38:53.252166 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.252022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerDied","Data":"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"}
Jul 16 22:38:53.252453 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.252440    2568 scope.go:117] "RemoveContainer" containerID="1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"
Jul 16 22:38:53.253551 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.253506    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:53.253606 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.253594    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:53.253648 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:53.253633    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 16 22:38:54.259286 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:54.259245    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerStarted","Data":"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"}
Jul 16 22:38:54.633659 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:54.633570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:54.633879 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:54.633856    2568 patch_prober.go:28] interesting pod/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 16 22:38:54.633968 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:54.633916    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 16 22:38:55.633788 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:55.633747    2568 patch_prober.go:28] interesting pod/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 16 22:38:55.634186 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:55.633813    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 16 22:38:56.634262 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:56.634227    2568 patch_prober.go:28] interesting pod/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 16 22:38:56.634698 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:56.634285    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 16 22:38:57.634219 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:57.634188    2568 patch_prober.go:28] interesting pod/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 16 22:38:57.634386 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:57.634242    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 16 22:38:58.637609 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:58.637577    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:58.638146 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:58.637849    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:38:58.638604 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:38:58.638588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:39:00.249423 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.249381    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:39:00.249890 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.249874    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd312f2-96e9-4cbf-ad8c-960211127b28" containerName="istio-proxy"
Jul 16 22:39:00.252261 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.252242    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.259765 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.259417    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb55e2\"/\"openshift-service-ca.crt\""
Jul 16 22:39:00.259765 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.259461    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb55e2\"/\"auth-test-model-bb55e2-kserve-self-signed-certs\""
Jul 16 22:39:00.259765 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.259509    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bb55e2\"/\"kube-root-ca.crt\""
Jul 16 22:39:00.259962 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.259814    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bb55e2\"/\"default-dockercfg-hdb74\""
Jul 16 22:39:00.285179 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.285142    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:39:00.413112 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413078    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wp5t\" (UniqueName: \"kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.413323 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413249    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.413405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.413467 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.413467 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.413604 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.413565    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.514925 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.514824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wp5t\" (UniqueName: \"kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.514925 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.514892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.514925 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.514932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515226 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.514954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515226 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.514973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515226 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.515000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515490 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.515449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.515462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.515649 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.515510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.517465 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.517440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.517626 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.517607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.523485 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.523462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wp5t\" (UniqueName: \"kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t\") pod \"auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") " pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.563157 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.563124    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:00.708441 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:00.708419    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:39:00.710846 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:39:00.710815    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd017992f_9fd3_4715_87f3_cea56a1a8dbe.slice/crio-39c3e64522f25cb7040d09e2c2be92f06f7825b2b74d07833cefe4948a565f2e WatchSource:0}: Error finding container 39c3e64522f25cb7040d09e2c2be92f06f7825b2b74d07833cefe4948a565f2e: Status 404 returned error can't find the container with id 39c3e64522f25cb7040d09e2c2be92f06f7825b2b74d07833cefe4948a565f2e
Jul 16 22:39:01.295955 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:01.295920    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" event={"ID":"d017992f-9fd3-4715-87f3-cea56a1a8dbe","Type":"ContainerStarted","Data":"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"}
Jul 16 22:39:01.296404 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:01.295967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" event={"ID":"d017992f-9fd3-4715-87f3-cea56a1a8dbe","Type":"ContainerStarted","Data":"39c3e64522f25cb7040d09e2c2be92f06f7825b2b74d07833cefe4948a565f2e"}
Jul 16 22:39:01.335505 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:01.335450    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" podStartSLOduration=1.335430693 podStartE2EDuration="1.335430693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:39:01.335202473 +0000 UTC m=+2996.639299888" watchObservedRunningTime="2026-07-16 22:39:01.335430693 +0000 UTC m=+2996.639528060"
Jul 16 22:39:10.563746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:10.563699    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:10.563746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:10.563758    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:10.576722 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:10.576693    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:39:11.355302 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:39:11.355271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:41:59.279583 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:41:59.279547    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:42:14.300077 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.300027    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" podUID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" containerName="main" containerID="cri-o://5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8" gracePeriod=45
Jul 16 22:42:14.560120 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.560057    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:42:14.692317 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692277    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wp5t\" (UniqueName: \"kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692555 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692555 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692555 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692439    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692555 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692485    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692555 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache\") pod \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\" (UID: \"d017992f-9fd3-4715-87f3-cea56a1a8dbe\") "
Jul 16 22:42:14.692827 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692735    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:14.692934 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692885    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache" (OuterVolumeSpecName: "model-cache") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:14.692991 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692921    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tmp-dir\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:14.692991 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.692921    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home" (OuterVolumeSpecName: "home") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:14.694876 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.694845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm" (OuterVolumeSpecName: "dshm") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:42:14.694876 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.694854    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:42:14.695011 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.694922    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t" (OuterVolumeSpecName: "kube-api-access-2wp5t") pod "d017992f-9fd3-4715-87f3-cea56a1a8dbe" (UID: "d017992f-9fd3-4715-87f3-cea56a1a8dbe"). InnerVolumeSpecName "kube-api-access-2wp5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:42:14.793448 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.793401    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-dshm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:14.793448 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.793432    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d017992f-9fd3-4715-87f3-cea56a1a8dbe-tls-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:14.793448 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.793443    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-model-cache\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:14.793448 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.793452    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wp5t\" (UniqueName: \"kubernetes.io/projected/d017992f-9fd3-4715-87f3-cea56a1a8dbe-kube-api-access-2wp5t\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:14.793448 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:14.793460    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d017992f-9fd3-4715-87f3-cea56a1a8dbe-home\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:42:15.212445 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.212407    2568 generic.go:356] "Generic (PLEG): container finished" podID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" containerID="5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8" exitCode=0
Jul 16 22:42:15.212639 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.212454    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"
Jul 16 22:42:15.212639 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.212489    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" event={"ID":"d017992f-9fd3-4715-87f3-cea56a1a8dbe","Type":"ContainerDied","Data":"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"}
Jul 16 22:42:15.212639 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.212551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv" event={"ID":"d017992f-9fd3-4715-87f3-cea56a1a8dbe","Type":"ContainerDied","Data":"39c3e64522f25cb7040d09e2c2be92f06f7825b2b74d07833cefe4948a565f2e"}
Jul 16 22:42:15.212639 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.212574    2568 scope.go:117] "RemoveContainer" containerID="5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"
Jul 16 22:42:15.222005 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.221986    2568 scope.go:117] "RemoveContainer" containerID="5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"
Jul 16 22:42:15.222321 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:42:15.222297    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8\": container with ID starting with 5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8 not found: ID does not exist" containerID="5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"
Jul 16 22:42:15.222385 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.222331    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8"} err="failed to get container status \"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8\": rpc error: code = NotFound desc = could not find container \"5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8\": container with ID starting with 5022015e9765ab817340773a71ed8b4133f9d9091a635faab1b6f9be5bb341c8 not found: ID does not exist"
Jul 16 22:42:15.234470 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.234445    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:42:15.238819 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:15.238794    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bb55e2/auth-test-model-bb55e2-kserve-54d5f7d559-5vxcv"]
Jul 16 22:42:17.234064 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:17.234020    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" path="/var/lib/kubelet/pods/d017992f-9fd3-4715-87f3-cea56a1a8dbe/volumes"
Jul 16 22:42:26.506005 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.505970    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:42:26.506503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.506337    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" containerName="main"
Jul 16 22:42:26.506503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.506349    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" containerName="main"
Jul 16 22:42:26.506503 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.506435    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d017992f-9fd3-4715-87f3-cea56a1a8dbe" containerName="main"
Jul 16 22:42:26.510724 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.510704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.514317 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.514292    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"kube-root-ca.crt\""
Jul 16 22:42:26.515001 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.514982    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"sub-test-model-dbc614-kserve-self-signed-certs\""
Jul 16 22:42:26.515115 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.515052    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"openshift-service-ca.crt\""
Jul 16 22:42:26.515187 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.515119    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"default-dockercfg-z677v\""
Jul 16 22:42:26.520600 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.520578    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:42:26.614059 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.614267 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614087    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.614267 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphx6\" (UniqueName: \"kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.614267 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614201    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.614267 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.614267 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.614253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.715843 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.715803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.715868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nphx6\" (UniqueName: \"kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.715909    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.715946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.715978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716054 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.716043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716324 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.716274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716324 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.716276    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.716435 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.716331    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.718385 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.718353    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.718686 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.718668    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.725980 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.725950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphx6\" (UniqueName: \"kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6\") pod \"sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") " pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.820951 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.820856    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:26.965031 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:26.965006    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:42:26.967268 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:42:26.967239    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f7de6ca_842c_4f6f_bf69_d9d47d82b0f7.slice/crio-ab310f08d7dd432429d152f9b063235b35a79b920de08d2afe160461fdaf17af WatchSource:0}: Error finding container ab310f08d7dd432429d152f9b063235b35a79b920de08d2afe160461fdaf17af: Status 404 returned error can't find the container with id ab310f08d7dd432429d152f9b063235b35a79b920de08d2afe160461fdaf17af
Jul 16 22:42:27.270677 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:27.270639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" event={"ID":"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7","Type":"ContainerStarted","Data":"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"}
Jul 16 22:42:27.270852 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:27.270686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" event={"ID":"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7","Type":"ContainerStarted","Data":"ab310f08d7dd432429d152f9b063235b35a79b920de08d2afe160461fdaf17af"}
Jul 16 22:42:27.292692 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:27.292625    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" podStartSLOduration=1.292607542 podStartE2EDuration="1.292607542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:42:27.289975616 +0000 UTC m=+3202.594072985" watchObservedRunningTime="2026-07-16 22:42:27.292607542 +0000 UTC m=+3202.596704909"
Jul 16 22:42:36.821016 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:36.820963    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:36.821489 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:36.821120    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:36.833623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:36.833598    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:42:37.331164 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:42:37.331135    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:43:21.909394 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:21.909354    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:43:36.930119 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:36.930053    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" podUID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" containerName="main" containerID="cri-o://148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c" gracePeriod=45
Jul 16 22:43:37.190339 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.190264    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:43:37.219193 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219379 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219214    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219379 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219379 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219249    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219379 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219285    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219379 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219366    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nphx6\" (UniqueName: \"kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6\") pod \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\" (UID: \"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7\") "
Jul 16 22:43:37.219692 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219508    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:37.219692 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219517    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:37.219692 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219551    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home" (OuterVolumeSpecName: "home") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:37.219814 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219742    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-model-cache\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.219814 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219761    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tmp-dir\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.219814 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.219775    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-home\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.221799 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.221773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm" (OuterVolumeSpecName: "dshm") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:43:37.221799 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.221779    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:43:37.221799 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.221787    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6" (OuterVolumeSpecName: "kube-api-access-nphx6") pod "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" (UID: "2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7"). InnerVolumeSpecName "kube-api-access-nphx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:43:37.320402 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.320369    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-tls-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.320402 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.320397    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nphx6\" (UniqueName: \"kubernetes.io/projected/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-kube-api-access-nphx6\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.320402 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.320406    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7-dshm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:43:37.619907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.619819    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" containerID="148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c" exitCode=0
Jul 16 22:43:37.619907 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.619862    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"
Jul 16 22:43:37.620088 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.619905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" event={"ID":"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7","Type":"ContainerDied","Data":"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"}
Jul 16 22:43:37.620088 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.619952    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t" event={"ID":"2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7","Type":"ContainerDied","Data":"ab310f08d7dd432429d152f9b063235b35a79b920de08d2afe160461fdaf17af"}
Jul 16 22:43:37.620088 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.619972    2568 scope.go:117] "RemoveContainer" containerID="148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"
Jul 16 22:43:37.628594 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.628578    2568 scope.go:117] "RemoveContainer" containerID="148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"
Jul 16 22:43:37.628865 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:43:37.628844    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c\": container with ID starting with 148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c not found: ID does not exist" containerID="148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"
Jul 16 22:43:37.628947 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.628874    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c"} err="failed to get container status \"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c\": rpc error: code = NotFound desc = could not find container \"148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c\": container with ID starting with 148325e33871cd7527ade33ba4704b8c1f2f7332715d630a29d3628fecfb723c not found: ID does not exist"
Jul 16 22:43:37.655776 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.655743    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:43:37.672538 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:37.672494    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/sub-test-model-dbc614-kserve-54f4bdbc95-n6t2t"]
Jul 16 22:43:39.233631 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:43:39.233587    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" path="/var/lib/kubelet/pods/2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7/volumes"
Jul 16 22:44:18.714152 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.714118    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:44:18.714722 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.714513    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" containerName="main"
Jul 16 22:44:18.714722 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.714552    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" containerName="main"
Jul 16 22:44:18.714722 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.714624    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f7de6ca-842c-4f6f-bf69-d9d47d82b0f7" containerName="main"
Jul 16 22:44:18.717653 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.717633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.724839 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.724815    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"kube-root-ca.crt\""
Jul 16 22:44:18.724930 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.724882    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"rate-test-model-dbc614-kserve-self-signed-certs\""
Jul 16 22:44:18.725657 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.725636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"default-dockercfg-z677v\""
Jul 16 22:44:18.725772 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.725637    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-dbc614\"/\"openshift-service-ca.crt\""
Jul 16 22:44:18.750098 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.750062    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:44:18.828504 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.828729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.828729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.828729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.828729 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.828881 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.828734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8cr\" (UniqueName: \"kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929623 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929831 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929831 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929831 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929726    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929831 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.929831 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.929771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8cr\" (UniqueName: \"kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.930158 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.930128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.930224 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.930174    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.930224 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.930202    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.932045 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.932022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.932321 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.932303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:18.950897 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:18.950864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8cr\" (UniqueName: \"kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr\") pod \"rate-test-model-dbc614-kserve-7658957d7f-ff4fk\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") " pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:19.027250 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:19.027138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:19.190671 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:19.190627    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:44:19.192890 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:44:19.192855    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d0a2bfa_970f_421e_9f3d_1bc3b6d165be.slice/crio-90d98c2f147d9aa16e12ff24801d63f7572460ff2da63e6e0beb0f425efc4908 WatchSource:0}: Error finding container 90d98c2f147d9aa16e12ff24801d63f7572460ff2da63e6e0beb0f425efc4908: Status 404 returned error can't find the container with id 90d98c2f147d9aa16e12ff24801d63f7572460ff2da63e6e0beb0f425efc4908
Jul 16 22:44:19.823239 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:19.823206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" event={"ID":"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be","Type":"ContainerStarted","Data":"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"}
Jul 16 22:44:19.823239 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:19.823245    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" event={"ID":"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be","Type":"ContainerStarted","Data":"90d98c2f147d9aa16e12ff24801d63f7572460ff2da63e6e0beb0f425efc4908"}
Jul 16 22:44:29.027358 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:29.027263    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:29.027358 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:29.027315    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:29.040701 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:29.040670    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:44:29.064248 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:29.064187    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" podStartSLOduration=11.06416732 podStartE2EDuration="11.06416732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:44:19.864357408 +0000 UTC m=+3315.168454775" watchObservedRunningTime="2026-07-16 22:44:29.06416732 +0000 UTC m=+3324.368264689"
Jul 16 22:44:29.881276 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:44:29.881248    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:45:04.375056 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:04.375018    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:45:19.395627 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.395564    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" podUID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" containerName="main" containerID="cri-o://395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2" gracePeriod=45
Jul 16 22:45:19.647795 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.647729    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:45:19.654111 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654091    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw8cr\" (UniqueName: \"kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654228 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654141    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654289 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654248    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654289 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654279    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654400 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654330    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654400 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654377    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home\") pod \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\" (UID: \"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be\") "
Jul 16 22:45:19.654507 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654413    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache" (OuterVolumeSpecName: "model-cache") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:19.654582 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654567    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:19.654757 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654728    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tmp-dir\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:19.654865 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654774    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-model-cache\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:19.654865 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.654710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home" (OuterVolumeSpecName: "home") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:19.656418 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.656390    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr" (OuterVolumeSpecName: "kube-api-access-vw8cr") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "kube-api-access-vw8cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:19.656418 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.656393    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm" (OuterVolumeSpecName: "dshm") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:19.656562 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.656420    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" (UID: "4d0a2bfa-970f-421e-9f3d-1bc3b6d165be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:45:19.756023 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.755974    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-dshm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:19.756023 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.756017    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-tls-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:19.756023 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.756028    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-home\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:19.756023 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:19.756037    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw8cr\" (UniqueName: \"kubernetes.io/projected/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be-kube-api-access-vw8cr\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:20.112204 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.112113    2568 generic.go:356] "Generic (PLEG): container finished" podID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" containerID="395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2" exitCode=0
Jul 16 22:45:20.112204 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.112163    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"
Jul 16 22:45:20.112444 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.112214    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" event={"ID":"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be","Type":"ContainerDied","Data":"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"}
Jul 16 22:45:20.112444 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.112261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk" event={"ID":"4d0a2bfa-970f-421e-9f3d-1bc3b6d165be","Type":"ContainerDied","Data":"90d98c2f147d9aa16e12ff24801d63f7572460ff2da63e6e0beb0f425efc4908"}
Jul 16 22:45:20.112444 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.112283    2568 scope.go:117] "RemoveContainer" containerID="395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"
Jul 16 22:45:20.121377 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.121360    2568 scope.go:117] "RemoveContainer" containerID="395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"
Jul 16 22:45:20.121697 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:45:20.121676    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2\": container with ID starting with 395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2 not found: ID does not exist" containerID="395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"
Jul 16 22:45:20.121756 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.121705    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2"} err="failed to get container status \"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2\": rpc error: code = NotFound desc = could not find container \"395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2\": container with ID starting with 395d8dddb7658a67e4c2e06d366aadce482a43319302ccee4e28f14c2ada42d2 not found: ID does not exist"
Jul 16 22:45:20.137854 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.137828    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:45:20.143058 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:20.143036    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-dbc614/rate-test-model-dbc614-kserve-7658957d7f-ff4fk"]
Jul 16 22:45:21.233109 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:21.233076    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" path="/var/lib/kubelet/pods/4d0a2bfa-970f-421e-9f3d-1bc3b6d165be/volumes"
Jul 16 22:45:49.859438 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:49.859398    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:45:49.860035 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:49.859742    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy" containerID="cri-o://128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139" gracePeriod=30
Jul 16 22:45:55.121543 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.121495    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:45:55.203022 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.202981    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203208 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203034    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203208 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203208 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203121    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203208 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203151    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203208 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203178    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203208    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7t8p\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203279    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203316    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert\") pod \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\" (UID: \"d99d8264-6096-405a-ba31-0e7bbbb2c47a\") "
Jul 16 22:45:55.203457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203373    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.203755 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203734    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.203823 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203735    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:45:55.203823 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203760    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.203933 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.203923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.204260 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.204210    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.205648 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.205611    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p" (OuterVolumeSpecName: "kube-api-access-w7t8p") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "kube-api-access-w7t8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:55.205746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.205689    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:45:55.205746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.205697    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:45:55.205746 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.205714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d99d8264-6096-405a-ba31-0e7bbbb2c47a" (UID: "d99d8264-6096-405a-ba31-0e7bbbb2c47a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:45:55.286787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.286716    2568 generic.go:356] "Generic (PLEG): container finished" podID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerID="128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139" exitCode=0
Jul 16 22:45:55.286787 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.286776    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"
Jul 16 22:45:55.286980 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.286810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerDied","Data":"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"}
Jul 16 22:45:55.286980 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.286874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn" event={"ID":"d99d8264-6096-405a-ba31-0e7bbbb2c47a","Type":"ContainerDied","Data":"0f3b8aa6f31d825c95e433184042dc4daa1cb585848613c4268ffb816797c5ea"}
Jul 16 22:45:55.286980 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.286903    2568 scope.go:117] "RemoveContainer" containerID="128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"
Jul 16 22:45:55.295741 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.295718    2568 scope.go:117] "RemoveContainer" containerID="33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"
Jul 16 22:45:55.304243 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304220    2568 scope.go:117] "RemoveContainer" containerID="128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"
Jul 16 22:45:55.304366 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304346    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304373    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304387    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304400    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304413    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7t8p\" (UniqueName: \"kubernetes.io/projected/d99d8264-6096-405a-ba31-0e7bbbb2c47a-kube-api-access-w7t8p\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304429    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304440    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.304457 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.304450    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99d8264-6096-405a-ba31-0e7bbbb2c47a-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:45:55.305232 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:45:55.305189    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139\": container with ID starting with 128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139 not found: ID does not exist" containerID="128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"
Jul 16 22:45:55.305330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.305231    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139"} err="failed to get container status \"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139\": rpc error: code = NotFound desc = could not find container \"128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139\": container with ID starting with 128db8de112718f700ded1621471512068fabd68bdb7a94d9c59e162fdab5139 not found: ID does not exist"
Jul 16 22:45:55.305330 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.305257    2568 scope.go:117] "RemoveContainer" containerID="33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"
Jul 16 22:45:55.305577 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:45:55.305558    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a\": container with ID starting with 33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a not found: ID does not exist" containerID="33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"
Jul 16 22:45:55.305646 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.305583    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a"} err="failed to get container status \"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a\": rpc error: code = NotFound desc = could not find container \"33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a\": container with ID starting with 33a377aaaf2bc6b371b7f3c59615d137ef01b8287caeee40f84fe32413ea809a not found: ID does not exist"
Jul 16 22:45:55.306937 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.306913    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:45:55.310904 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:55.310882    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bb55e2-openshift-default-7b4cff6fff-r2ftn"]
Jul 16 22:45:57.233875 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:45:57.233842    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" path="/var/lib/kubelet/pods/d99d8264-6096-405a-ba31-0e7bbbb2c47a/volumes"
Jul 16 22:46:16.071998 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:16.071965    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:46:16.072496 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:16.072176    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy" containerID="cri-o://b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083" gracePeriod=30
Jul 16 22:46:21.329621 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.329592    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:46:21.409210 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.409173    2568 generic.go:356] "Generic (PLEG): container finished" podID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerID="b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083" exitCode=0
Jul 16 22:46:21.409405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.409227    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"
Jul 16 22:46:21.409405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.409259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerDied","Data":"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"}
Jul 16 22:46:21.409405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.409314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs" event={"ID":"a65a1873-4969-465a-9d3a-4e056cef31e1","Type":"ContainerDied","Data":"0fcd60a3d7a4cd1b1a4f18313102d0be19e812819477ae427f83db829740b0dc"}
Jul 16 22:46:21.409405 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.409336    2568 scope.go:117] "RemoveContainer" containerID="b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"
Jul 16 22:46:21.418065 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.418047    2568 scope.go:117] "RemoveContainer" containerID="1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"
Jul 16 22:46:21.425994 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.425974    2568 scope.go:117] "RemoveContainer" containerID="b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"
Jul 16 22:46:21.426262 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:46:21.426243    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083\": container with ID starting with b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083 not found: ID does not exist" containerID="b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"
Jul 16 22:46:21.426310 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.426274    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083"} err="failed to get container status \"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083\": rpc error: code = NotFound desc = could not find container \"b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083\": container with ID starting with b35dd6b1b7b77f9a11f589e0bb9a1160d9310f443dd6056aa65752b250c4b083 not found: ID does not exist"
Jul 16 22:46:21.426310 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.426294    2568 scope.go:117] "RemoveContainer" containerID="1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"
Jul 16 22:46:21.426578 ip-10-0-141-223 kubenswrapper[2568]: E0716 22:46:21.426555    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36\": container with ID starting with 1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36 not found: ID does not exist" containerID="1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"
Jul 16 22:46:21.426653 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.426586    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36"} err="failed to get container status \"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36\": rpc error: code = NotFound desc = could not find container \"1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36\": container with ID starting with 1d642f09f227e961f9bccb4961da4180a99ff3550410c024fe5c983c8c23ba36 not found: ID does not exist"
Jul 16 22:46:21.452917 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.452881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.452917 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.452921    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453124 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.452965    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453124 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.452983    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453124 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453000    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trfkx\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453124 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453035    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453124 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453079    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453393 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453157    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453393 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453189    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert\") pod \"a65a1873-4969-465a-9d3a-4e056cef31e1\" (UID: \"a65a1873-4969-465a-9d3a-4e056cef31e1\") "
Jul 16 22:46:21.453393 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:46:21.453393 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:46:21.453657 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453572    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:46:21.453719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453655    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.453719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453674    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.453719 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.453675    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:46:21.454274 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.454246    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:46:21.455578 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.455543    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:46:21.455689 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.455593    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx" (OuterVolumeSpecName: "kube-api-access-trfkx") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "kube-api-access-trfkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:46:21.455689 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.455602    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:46:21.455804 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.455714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a65a1873-4969-465a-9d3a-4e056cef31e1" (UID: "a65a1873-4969-465a-9d3a-4e056cef31e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:46:21.554435 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554389    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554435 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554429    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554435 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554439    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554696 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554447    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trfkx\" (UniqueName: \"kubernetes.io/projected/a65a1873-4969-465a-9d3a-4e056cef31e1-kube-api-access-trfkx\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554696 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554457    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554696 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554465    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a65a1873-4969-465a-9d3a-4e056cef31e1-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.554696 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.554472    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a65a1873-4969-465a-9d3a-4e056cef31e1-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 16 22:46:21.732790 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.732748    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:46:21.739872 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:21.739846    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-dbc614-openshift-default-67fbf8bbc9-76zfs"]
Jul 16 22:46:22.963819 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:22.963790    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qfzbg_9496bf43-745d-479c-9e71-4fe302e6d462/server/0.log"
Jul 16 22:46:23.082302 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:23.082268    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lmssl_92607a4e-fc86-4516-aa9f-2672fb4a45c1/manager/0.log"
Jul 16 22:46:23.234181 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:23.234090    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" path="/var/lib/kubelet/pods/a65a1873-4969-465a-9d3a-4e056cef31e1/volumes"
Jul 16 22:46:23.353634 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:23.353606    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cf7dfc9c-stcvv_90deca17-6cae-4588-bb86-183b8816af0c/copy-manifests/0.log"
Jul 16 22:46:23.360973 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:23.360932    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cf7dfc9c-stcvv_90deca17-6cae-4588-bb86-183b8816af0c/manager/0.log"
Jul 16 22:46:27.409808 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:27.409781    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tmqqb_b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae/kuadrant-console-plugin/0.log"
Jul 16 22:46:28.273399 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:28.273369    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lrddk_b50c72cd-7ca0-458d-8b49-3ba481964ed3/istio-proxy/0.log"
Jul 16 22:46:28.603147 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:28.603060    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695b65bf64-6mrwh_314708d5-b9a2-4562-a59c-276ff095e1b0/kube-auth-proxy/0.log"
Jul 16 22:46:28.849039 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:28.849008    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/1.log"
Jul 16 22:46:29.689288 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:29.689230    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8ch6d_42b2120d-14c6-48a0-b5a8-6ac9dc06cbc8/main/0.log"
Jul 16 22:46:30.050271 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:30.050184    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-sp24w_b36eda75-0b1b-4e96-99ac-ce821ba81bd1/main/0.log"
Jul 16 22:46:30.173797 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:30.173770    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bz2s9_bf77e730-a881-4774-8770-76536274bc7a/main/0.log"
Jul 16 22:46:35.639425 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639392    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq9hl/must-gather-bn5zl"]
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639754    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639766    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639779    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639784    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639799    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" containerName="main"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639805    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" containerName="main"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639866    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639873    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639879    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639886    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0a2bfa-970f-421e-9f3d-1bc3b6d165be" containerName="main"
Jul 16 22:46:35.639887 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.640231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639946    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.640231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639953    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99d8264-6096-405a-ba31-0e7bbbb2c47a" containerName="istio-proxy"
Jul 16 22:46:35.640231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639963    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.640231 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.639970    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65a1873-4969-465a-9d3a-4e056cef31e1" containerName="istio-proxy"
Jul 16 22:46:35.644829 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.644797    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.649229 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.649203    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq9hl\"/\"openshift-service-ca.crt\""
Jul 16 22:46:35.649393 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.649320    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zq9hl\"/\"kube-root-ca.crt\""
Jul 16 22:46:35.657237 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.657205    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq9hl/must-gather-bn5zl"]
Jul 16 22:46:35.689512 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.689465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-must-gather-output\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.689701 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.689616    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5w7q\" (UniqueName: \"kubernetes.io/projected/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-kube-api-access-p5w7q\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.790889 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.790842    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5w7q\" (UniqueName: \"kubernetes.io/projected/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-kube-api-access-p5w7q\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.791069 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.790917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-must-gather-output\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.791230 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.791215    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-must-gather-output\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.822292 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.822256    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5w7q\" (UniqueName: \"kubernetes.io/projected/a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2-kube-api-access-p5w7q\") pod \"must-gather-bn5zl\" (UID: \"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2\") " pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:35.954815 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:35.954723    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq9hl/must-gather-bn5zl"
Jul 16 22:46:36.115020 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:36.114992    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq9hl/must-gather-bn5zl"]
Jul 16 22:46:36.117153 ip-10-0-141-223 kubenswrapper[2568]: W0716 22:46:36.117129    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a0885f_942d_4f4a_ad7a_6da9f1cfa0f2.slice/crio-fd63e8607303c97efaa04add34a4c4ebfae572092f4fadcc67b04b9073c06566 WatchSource:0}: Error finding container fd63e8607303c97efaa04add34a4c4ebfae572092f4fadcc67b04b9073c06566: Status 404 returned error can't find the container with id fd63e8607303c97efaa04add34a4c4ebfae572092f4fadcc67b04b9073c06566
Jul 16 22:46:36.118883 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:36.118864    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:46:36.479803 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:36.479763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq9hl/must-gather-bn5zl" event={"ID":"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2","Type":"ContainerStarted","Data":"fd63e8607303c97efaa04add34a4c4ebfae572092f4fadcc67b04b9073c06566"}
Jul 16 22:46:37.486066 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:37.486024    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq9hl/must-gather-bn5zl" event={"ID":"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2","Type":"ContainerStarted","Data":"7198af8a44e918f688b239b44f91f981b637d8adfaa05580ed57a8218d2a81b9"}
Jul 16 22:46:37.486066 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:37.486069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq9hl/must-gather-bn5zl" event={"ID":"a6a0885f-942d-4f4a-ad7a-6da9f1cfa0f2","Type":"ContainerStarted","Data":"0d71ee71f82b3a283d8d3020b3467ecc19d4a51ec6f25eb9a91345f8a7d4b6d9"}
Jul 16 22:46:39.000378 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:39.000349    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mxv2g_e46a5457-5741-462c-8660-e759330a19be/global-pull-secret-syncer/0.log"
Jul 16 22:46:39.234277 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:39.234243    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8h8mq_7818dfc8-cf7c-4081-b2fe-31b5cef0666a/konnectivity-agent/0.log"
Jul 16 22:46:39.469420 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:39.469391    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-223.ec2.internal_b7fe9da6afc82c85af7e8ff02c28a425/haproxy/0.log"
Jul 16 22:46:44.206954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:44.206920    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tmqqb_b0ab52f3-68b8-4b13-a1c7-0bcb7a394dae/kuadrant-console-plugin/0.log"
Jul 16 22:46:47.008055 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.008018    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-866995875d-jmtmm_5693ff26-8cde-4751-bf0b-831cc409e292/metrics-server/0.log"
Jul 16 22:46:47.379673 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.379512    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zjqzf_04e7b928-0367-4766-a853-8d7297d5d1e8/node-exporter/0.log"
Jul 16 22:46:47.405227 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.405196    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zjqzf_04e7b928-0367-4766-a853-8d7297d5d1e8/kube-rbac-proxy/0.log"
Jul 16 22:46:47.429199 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.429174    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zjqzf_04e7b928-0367-4766-a853-8d7297d5d1e8/init-textfile/0.log"
Jul 16 22:46:47.457799 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.457772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dnb5g_b73fe4c0-7e6c-4008-94ef-759893e86309/kube-rbac-proxy-main/0.log"
Jul 16 22:46:47.482565 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.482516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dnb5g_b73fe4c0-7e6c-4008-94ef-759893e86309/kube-rbac-proxy-self/0.log"
Jul 16 22:46:47.527390 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.527338    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-dnb5g_b73fe4c0-7e6c-4008-94ef-759893e86309/openshift-state-metrics/0.log"
Jul 16 22:46:47.571189 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.571160    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/prometheus/0.log"
Jul 16 22:46:47.596664 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.596638    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/config-reloader/0.log"
Jul 16 22:46:47.622378 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.622343    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/thanos-sidecar/0.log"
Jul 16 22:46:47.653167 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.653139    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/kube-rbac-proxy-web/0.log"
Jul 16 22:46:47.681027 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.680972    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/kube-rbac-proxy/0.log"
Jul 16 22:46:47.713320 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.713274    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/kube-rbac-proxy-thanos/0.log"
Jul 16 22:46:47.738805 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.738772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5201fd4c-897e-4bff-b545-ee9d303226d6/init-config-reloader/0.log"
Jul 16 22:46:47.932404 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.932310    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/thanos-query/0.log"
Jul 16 22:46:47.959867 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.959844    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/kube-rbac-proxy-web/0.log"
Jul 16 22:46:47.991129 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:47.991090    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/kube-rbac-proxy/0.log"
Jul 16 22:46:48.017472 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.017439    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/prom-label-proxy/0.log"
Jul 16 22:46:48.044460 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.044389    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/kube-rbac-proxy-rules/0.log"
Jul 16 22:46:48.069123 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.069094    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56b9df4b9d-htdtr_041618fa-bbe9-475d-9b89-f6dbabd3bea3/kube-rbac-proxy-metrics/0.log"
Jul 16 22:46:48.839607 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.839547    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq9hl/must-gather-bn5zl" podStartSLOduration=13.052042297 podStartE2EDuration="13.839505528s" totalImagesPullingTime="787.463231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:46:37.533307975 +0000 UTC m=+3452.837405321" watchObservedRunningTime="2026-07-16 22:46:48.839505528 +0000 UTC m=+3464.143602896"
Jul 16 22:46:48.839959 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.839939    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"]
Jul 16 22:46:48.846112 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.846071    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:48.850191 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.850166    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zq9hl\"/\"default-dockercfg-q7xtq\""
Jul 16 22:46:48.855266 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.854713    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"]
Jul 16 22:46:48.931785 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.931742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-schct\" (UniqueName: \"kubernetes.io/projected/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-kube-api-access-schct\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:48.931999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.931917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-podres\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:48.931999 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.931957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-proc\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:48.932111 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.932024    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-sys\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:48.932111 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:48.932060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-lib-modules\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.033600 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-schct\" (UniqueName: \"kubernetes.io/projected/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-kube-api-access-schct\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-podres\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-proc\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033735    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-sys\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-lib-modules\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033822    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-podres\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-sys\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033887    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-lib-modules\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.034051 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.033852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-proc\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.043898 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.043859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-schct\" (UniqueName: \"kubernetes.io/projected/d543fed4-9f0f-4ebd-9c39-a9cdccb62deb-kube-api-access-schct\") pod \"perf-node-gather-daemonset-ptfnk\" (UID: \"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb\") " pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.159859 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.159819    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.350285 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.349944    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"]
Jul 16 22:46:49.568699 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.568658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk" event={"ID":"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb","Type":"ContainerStarted","Data":"56cb3fa044ba5befb0993f18ddbce4fd1d4e293283d565aacfe32761537fa201"}
Jul 16 22:46:49.568877 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.568727    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk" event={"ID":"d543fed4-9f0f-4ebd-9c39-a9cdccb62deb","Type":"ContainerStarted","Data":"b4d7f7e8c7201b0ecfc3692e5950bb0b94d636fb2a433feeb5409951d1d8fced"}
Jul 16 22:46:49.569550 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.569502    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:49.607881 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:49.607823    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk" podStartSLOduration=1.607804663 podStartE2EDuration="1.607804663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:46:49.607469471 +0000 UTC m=+3464.911566837" watchObservedRunningTime="2026-07-16 22:46:49.607804663 +0000 UTC m=+3464.911902099"
Jul 16 22:46:50.546553 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:50.546512    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f5c7887f5-xhv8m_23081dcf-7e87-4f23-8e9e-74291ad8586d/console/0.log"
Jul 16 22:46:52.548264 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:52.548233    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5fjxg_65d54f38-e603-47fd-9794-b53ca161709b/dns/0.log"
Jul 16 22:46:52.599958 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:52.599932    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5fjxg_65d54f38-e603-47fd-9794-b53ca161709b/kube-rbac-proxy/0.log"
Jul 16 22:46:52.851919 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:52.851891    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnmcr_5fcd7322-99a0-43b3-bd32-85e80fd6e25e/dns-node-resolver/0.log"
Jul 16 22:46:53.441055 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:53.441018    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65ff4bbc6f-gk55q_0b090031-0bb8-41ae-a514-4db924a5b526/registry/0.log"
Jul 16 22:46:53.512988 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:53.512947    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qcxx7_f02dfdea-296f-401d-a667-94f4f3703d59/node-ca/0.log"
Jul 16 22:46:54.460142 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:54.460113    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lrddk_b50c72cd-7ca0-458d-8b49-3ba481964ed3/istio-proxy/0.log"
Jul 16 22:46:54.695866 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:54.695833    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695b65bf64-6mrwh_314708d5-b9a2-4562-a59c-276ff095e1b0/kube-auth-proxy/0.log"
Jul 16 22:46:54.756699 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:54.756624    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/0.log"
Jul 16 22:46:54.794547 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:54.794497    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/1.log"
Jul 16 22:46:55.621343 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:55.621308    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sksgz_52c1c841-cd28-4429-ba49-80ddc8415b94/serve-healthcheck-canary/0.log"
Jul 16 22:46:56.331396 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:56.331370    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fswkf_e3ffcaaf-2702-42f3-9edf-f9a35b032ffc/kube-rbac-proxy/0.log"
Jul 16 22:46:56.354657 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:56.354631    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fswkf_e3ffcaaf-2702-42f3-9edf-f9a35b032ffc/exporter/0.log"
Jul 16 22:46:56.375549 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:56.375499    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fswkf_e3ffcaaf-2702-42f3-9edf-f9a35b032ffc/extractor/0.log"
Jul 16 22:46:56.596560 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:56.595488    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zq9hl/perf-node-gather-daemonset-ptfnk"
Jul 16 22:46:59.093489 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:59.093464    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qfzbg_9496bf43-745d-479c-9e71-4fe302e6d462/server/0.log"
Jul 16 22:46:59.186327 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:59.186285    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lmssl_92607a4e-fc86-4516-aa9f-2672fb4a45c1/manager/0.log"
Jul 16 22:46:59.263430 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:59.263387    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cf7dfc9c-stcvv_90deca17-6cae-4588-bb86-183b8816af0c/manager/0.log"
Jul 16 22:46:59.283586 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:46:59.283560    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54cf7dfc9c-stcvv_90deca17-6cae-4588-bb86-183b8816af0c/copy-manifests/0.log"
Jul 16 22:47:00.014954 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:00.014925    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lrddk_b50c72cd-7ca0-458d-8b49-3ba481964ed3/istio-proxy/0.log"
Jul 16 22:47:00.240884 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:00.240861    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695b65bf64-6mrwh_314708d5-b9a2-4562-a59c-276ff095e1b0/kube-auth-proxy/0.log"
Jul 16 22:47:00.287812 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:00.287731    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/0.log"
Jul 16 22:47:00.332711 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:00.332668    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/1.log"
Jul 16 22:47:00.751754 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:00.751726    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-656bfb4b98-cn755_8427fcea-5c8b-45f7-983a-1afa62a0c282/manager/0.log"
Jul 16 22:47:01.686511 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:01.686478    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lrddk_b50c72cd-7ca0-458d-8b49-3ba481964ed3/istio-proxy/0.log"
Jul 16 22:47:01.985730 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:01.985664    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-695b65bf64-6mrwh_314708d5-b9a2-4562-a59c-276ff095e1b0/kube-auth-proxy/0.log"
Jul 16 22:47:02.038187 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:02.038158    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/0.log"
Jul 16 22:47:02.071737 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:02.071703    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-2hnbz_da83f182-6c16-4756-ad85-515254324c4e/istio-proxy/1.log"
Jul 16 22:47:05.900421 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:05.900391    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ghbjb_ecee6785-b126-4c41-b0e2-179442b27344/migrator/0.log"
Jul 16 22:47:05.923177 ip-10-0-141-223 kubenswrapper[2568]: I0716 22:47:05.923144    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ghbjb_ecee6785-b126-4c41-b0e2-179442b27344/graceful-termination/0.log"